not use tune run,how can I run the code.

[belle9217]

If I use pip install --pre --upgrade torchtune --extra-index-url https://download.pytorch.org/whl/nightly/cpu, and I need to modify the code in the torchtune package in the environment, it's not easy, how can you quickly modify the code?

[RdoubleA]

Hi @belle9217, could you provide a few more details on what you are trying to do? You should not need to modify the code in the package files itself.

Generally, if you want to copy and modify an existing config or recipe in the library, you can use tune cp (see here) to create a local copy in your project directory, and then you can edit however you want. This will need to be run with tune run to launch a fine-tuning job.

[dz1iang]

The following script can run on a single machine.

NPROC_PER_NODE=$(nvidia-smi --query-gpu=name --format=csv,noheader | wc -l)

DISTRIBUTED_LAUNCH_ARGS=(
    --nproc_per_node $NPROC_PER_NODE
    --nnodes 1
    --node_rank 0
    --master_addr 127.0.0.1
    --master_port 29500
)
torchrun ${DISTRIBUTED_LAUNCH_ARGS[@]} recipes/full_finetune_distributed.py --config recipes/configs/qwen2_5/0.5B_full.yaml

[belle9217]

@dz1iang yes,it works,that is all I need.