2026-08-31 13:43:43.576 | WARNING | acestep.training.trainer::40 - bitsandbytes not installed. Using standard AdamW. ░▒▓███████▓▒░▒▓█▓▒░▒▓███████▓▒░░▒▓████████▓▒░░▒▓███████▓▒░▒▓████████▓▒░▒▓████████▓▒░▒▓███████▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░▒▓█▓▒░░▒▓█▓▒░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░▒▓█▓▒░░▒▓█▓▒░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░░▒▓█▓▒░ ░▒▓██████▓▒░░▒▓█▓▒░▒▓█▓▒░░▒▓█▓▒░▒▓██████▓▒░ ░▒▓██████▓▒░ ░▒▓█▓▒░ ░▒▓██████▓▒░ ░▒▓███████▓▒░ ░▒▓█▓▒░▒▓█▓▒░▒▓█▓▒░░▒▓█▓▒░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░▒▓█▓▒░▒▓█▓▒░░▒▓█▓▒░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓█▓▒░ ░▒▓███████▓▒░░▒▓█▓▒░▒▓███████▓▒░░▒▓████████▓▒░▒▓███████▓▒░ ░▒▓█▓▒░ ░▒▓████████▓▒░▒▓█▓▒░ "Because Gradio is the spawn of Satan." Side-Step v2.0.0 -- Adapter Fine-Tuning CLI (LoRA + LoKR) Standalone: github.com/koda-dernet/Side-Step Mode : fixed (corrected timesteps + CFG dropout) Stack : Python 3.12.14 | PyTorch 2.10.0+cu128 | CUDA 12.8 | bf16 GPU : a 96 GB workstation-class card (95.0 GiB) ============================================================ Training Configuration ============================================================ [Model] Model variant........... turbo Checkpoint dir.......... music/checkpoints * Dataset dir............. music/tensors/fm-control/20260831T193904Z-fmctl0 [Device] Device.................. cuda:0 * Precision............... bf16 * [LoRA] Rank (r)................ 64 Alpha................... 128 Dropout................. 0.1 Target modules.......... q_proj, k_proj, v_proj, o_proj Bias.................... none [Training] Learning rate........... 1.0e-04 Batch size.............. 1 Grad accumulation....... 4 Effective batch......... 4 Max epochs.............. 10 * Warmup steps............ 100 Weight decay............ 0.01 Max grad norm........... 1 Seed.................... 42 [Corrected Training] CFG dropout ratio....... 0.15 Timestep mu............. -0.4 Timestep sigma.......... 1 Data proportion......... 0.5 [Checkpointing] Output dir.............. music/adapters/fm-control/20260831T193904Z-fmctl0-r64 * Save every N epochs..... 5 * Resume from............. (auto) [Logging] TensorBoard dir......... (auto) Log every N steps....... 10 Grad norms every N steps 50 ============================================================ (* = non-default value) ============================================================ [INFO] Loading model (variant=turbo, device=cuda:0) 2026-08-31 13:43:43 [INFO] acestep.training_v2.model_loader: [INFO] Loading model from music/checkpoints/acestep-v15-turbo (variant=turbo, dtype=torch.bfloat16) 2026-08-31 13:43:44 [INFO] acestep.training_v2.model_loader: [OK] Model on cuda:0 (torch.bfloat16), all params frozen 2026-08-31 13:43:45.610 | INFO | acestep.training.lora_injection:inject_lora_into_dit:232 - LoRA injected into DiT decoder: 2026-08-31 13:43:45.610 | INFO | acestep.training.lora_injection:inject_lora_into_dit:233 - Total parameters: 2,437,912,710 2026-08-31 13:43:45.610 | INFO | acestep.training.lora_injection:inject_lora_into_dit:234 - Trainable parameters: 44,040,192 (1.81%) 2026-08-31 13:43:45.610 | INFO | acestep.training.lora_injection:inject_lora_into_dit:237 - LoRA rank: 64, alpha: 128 2026-08-31 13:43:45 [INFO] acestep.training_v2.fixed_lora_module: [OK] LoRA injected: 44,040,192 trainable params 2026-08-31 13:43:45.612 | INFO | acestep.training.data_module:__init__:90 - PreprocessedTensorDataset: 24 samples from music/tensors/fm-control/20260831T193904Z-fmctl0 INFO: Using bfloat16 Automatic Mixed Precision (AMP) 2026-08-31 13:43:45 [INFO] lightning.pytorch.utilities.rank_zero: Using bfloat16 Automatic Mixed Precision (AMP) 2026-08-31 13:43:45 [INFO] acestep.training_v2.tensorboard_utils: [OK] TensorBoard logger initialised at music/adapters/fm-control/20260831T193904Z-fmctl0-r64/runs 2026-08-31 13:43:45 [INFO] acestep.training_v2.optim: [Side-Step] Using AdamW optimizer 2026-08-31 13:43:45.629 | INFO | acestep.training.lora_injection:_safe_enable_input_require_grads:50 - Skipping enable_input_require_grads for decoder: get_input_embeddings is not implemented (expected for DiT) [INFO] Loading model from music/checkpoints/acestep-v15-turbo (variant=turbo, dtype=torch.bfloat16) [OK] Model loaded with attn_implementation=sdpa [OK] Loaded 24 preprocessed samples [INFO] Starting training (devices: 1, strategy: auto, precision: bf16-mixed) [INFO] Training 44,040,192 parameters [INFO] Optimizer: adamw [INFO] Scheduler: cosine [INFO] Gradient checkpointing enabled (use_cache=False, input_grads=False) 2026-08-31 13:44:31 [INFO] acestep.training_v2.trainer_helpers: [OK] LoRA adapter saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/checkpoints/epoch_5_loss_0.8669 2026-08-31 13:44:32 [INFO] acestep.training_v2.trainer_helpers: Training checkpoint saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/checkpoints/epoch_5_loss_0.8669 (epoch 5, step 30) 2026-08-31 13:45:17 [INFO] acestep.training_v2.trainer_helpers: [OK] LoRA adapter saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/checkpoints/epoch_10_loss_0.7659 2026-08-31 13:45:18 [INFO] acestep.training_v2.trainer_helpers: Training checkpoint saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/checkpoints/epoch_10_loss_0.7659 (epoch 10, step 60) 2026-08-31 13:45:18 [INFO] acestep.training_v2.trainer_helpers: [OK] LoRA adapter saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/final 2026-08-31 13:45:18 [INFO] acestep.training_v2.trainer_helpers: [OK] Adapter verified: 44,040,192 params, 44,040,192 non-zero (100.0%), max|w|=0.025757 ============================================================ Training Complete ============================================================ Total time .......... 1m 33s Epochs .............. 0 / 10 Total steps ......... 60 Loss ................ 1.2104 -> 0.9297 Best loss ........... 0.6745 Peak VRAM ........... 5.7 GiB Saved Checkpoints: Epoch 5 Loss: 0.8669 Epoch 10 Loss: 0.7659 Output dir .......... music/adapters/fm-control/20260831T193904Z-fmctl0-r64 Final weights ....... music/adapters/fm-control/20260831T193904Z-fmctl0-r64/final (84.1 MiB) TensorBoard ......... music/adapters/fm-control/20260831T193904Z-fmctl0-r64/runs ============================================================ [OK] Epoch 1/10 in 10.0s, Loss: 1.2104 Epoch 2/10, Step 10, Loss: 1.0315 [OK] Epoch 2/10 in 8.9s, Loss: 1.0494 [OK] Epoch 3/10 in 9.0s, Loss: 0.9193 Epoch 4/10, Step 20, Loss: 0.8903 [OK] Epoch 4/10 in 9.0s, Loss: 0.8920 Epoch 5/10, Step 30, Loss: 0.8086 [OK] Epoch 5/10 in 9.0s, Loss: 0.8669 [OK] Checkpoint saved at epoch 5 [OK] Epoch 6/10 in 9.1s, Loss: 0.8501 Epoch 7/10, Step 40, Loss: 0.8306 [OK] Epoch 7/10 in 9.1s, Loss: 0.8328 [OK] Epoch 8/10 in 9.1s, Loss: 0.8005 Epoch 9/10, Step 50, Loss: 0.6745 [OK] Epoch 9/10 in 9.2s, Loss: 0.7932 Epoch 10/10, Step 60, Loss: 0.8096 [OK] Epoch 10/10 in 9.2s, Loss: 0.7659 [OK] Checkpoint saved at epoch 10 [OK] Training complete! LoRA saved to music/adapters/fm-control/20260831T193904Z-fmctl0-r64/final For inference, set your LoRA path to: music/adapters/fm-control/20260831T193904Z-fmctl0-r64/final