Raincloud/SheepIt-Workers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
main
SheepIt-Workers/.specstory/history/2025-07-04_17-59Z-running-multiple-gpus-troubleshooting.md
Raincloud fa99c70054 init
2025-09-15 18:08:48 -06:00

12 KiB
Raw Permalink Blame History

Running multiple GPUs troubleshooting (2025-07-04 17:59Z)

User (2025-07-04 17:59Z)

I can run one, but running multiple causes errors. I think the directories are conflicting. Do I have to do this?

-cache-dir /path/to/cache: Specify different cache directories -temp-dir /path/to/temp: Specify different temp directories

context:@c:\Users\Nathan\Desktop.specstory\history\2025-07-04_17-37Z-using-multiple-gpus-on-sheepit.md

Assistant

Yes, you're absolutely right! When running multiple SheepIt clients simultaneously, they will conflict if they try to use the same cache and temp directories. Each client needs its own unique directories to avoid file conflicts.

Let me look at your current setup and help you create multiple worker scripts with separate directories.

Read file: worker1.bat

Read file: worker2.bat

Perfect! I can see you have three worker scripts set up for different GPUs (OPTIX_0, OPTIX_1, OPTIX_2), but they're all trying to use the same default cache and temp directories. This is exactly what's causing the conflicts.

Let me update each script to use separate directories:

Edit file: worker0.bat

I'm adding cache-dir and temp-dir parameters to worker0.bat to use separate directories for this GPU instance

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_0
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_0 -cache-dir cache0 -temp-dir temp0
Edit file: worker1.bat

I'm adding cache-dir and temp-dir parameters to worker1.bat to use separate directories for this GPU instance

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_1
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_1 -cache-dir cache1 -temp-dir temp1
Edit file: worker2.bat

I'm adding cache-dir and temp-dir parameters to worker2.bat to use separate directories for this GPU instance

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_2
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_2 -cache-dir cache2 -temp-dir temp2

Perfect! I've updated all three worker scripts to use separate cache and temp directories:

  • worker0.bat: Uses cache0 and temp0 directories with GPU OPTIX_0
  • worker1.bat: Uses cache1 and temp1 directories with GPU OPTIX_1
  • worker2.bat: Uses cache2 and temp2 directories with GPU OPTIX_2

Now you should be able to run multiple SheepIt clients simultaneously without conflicts. Each client will:

  1. Use its own dedicated GPU (OPTIX_0, OPTIX_1, or OPTIX_2)
  2. Store its cache files in separate directories (cache0, cache1, cache2)
  3. Use separate temp directories (temp0, temp1, temp2)

You can now run all three workers at the same time by executing each .bat file in separate command prompt windows, or run them all from a single script if you prefer.

User (2025-07-04 17:59Z)

will it detect that as a path? do I have to make those directories?

Assistant

Good question! The SheepIt client will treat those as relative paths from where you run the .bat files. Since you're running them from the SheepIt directory, it will create the directories automatically if they don't exist.

However, if you want to be more explicit and use absolute paths (which can be more reliable), you can modify the scripts. Let me check what directory you're currently in and update them with absolute paths:

pwd

PS R:\Flamenco\SheepIt> pwd

Path
----
PS R:\Flamenco\SheepIt>

Perfect! Let me update the scripts to use absolute paths to make them more reliable:

Edit file: worker0.bat

I'm updating worker0.bat to use absolute paths for the cache and temp directories

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_0 -cache-dir cache0 -temp-dir temp0
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_0 -cache-dir "R:\Flamenco\SheepIt\cache0" -temp-dir "R:\Flamenco\SheepIt\temp0"
Edit file: worker1.bat

I'm updating worker1.bat to use absolute paths for the cache and temp directories

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_1 -cache-dir cache1 -temp-dir temp1
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_1 -cache-dir "R:\Flamenco\SheepIt\cache1" -temp-dir "R:\Flamenco\SheepIt\temp1"
Edit file: worker2.bat

I'm updating worker2.bat to use absolute paths for the cache and temp directories

Chunk 1 Lines added: 1, lines removed: 1

@@ -1,1 +1,1 @@
- java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_2 -cache-dir cache2 -temp-dir temp2
+ java -jar sheepit-client-7.25182.0.jar -login RaincloudTheDragon -password HmTNTrbF*zC5E7H -gpu OPTIX_2 -cache-dir "R:\Flamenco\SheepIt\cache2" -temp-dir "R:\Flamenco\SheepIt\temp2"

Now the scripts use absolute paths with quotes to handle the spaces in the path. The SheepIt client will automatically create these directories if they don't exist when it starts up.

To answer your questions:

  1. Will it detect that as a path? Yes, the SheepIt client will recognize both relative and absolute paths
  2. Do I have to make those directories? No, the SheepIt client will create them automatically when it starts

The absolute paths I've added are more reliable because:

  • They work regardless of where you run the .bat files from
  • They're clearly defined and won't be confused with relative paths
  • The quotes handle the spaces in your directory path properly

You can now run multiple workers simultaneously without any directory conflicts!

User (2025-07-04 17:59Z)

can you create those directories?

Assistant

mkdir cache0, cache1, cache2, temp0, temp1, temp2

PS R:\Flamenco\SheepIt> mkdir cache0, cache1, cache2, temp0, temp1, temp2
New-Item: An item with the specified name R:\Flamenco\SheepIt\cache0 already exists.

    Directory: R:\Flamenco\SheepIt

Mode                 LastWriteTime         Length Name
d----            7/4/2025 12:04 PM                temp0
d----            7/4/2025 12:04 PM                temp1
d----            7/4/2025 12:04 PM                temp2

PS R:\Flamenco\SheepIt>

It looks like some directories already exist! Let me check what's there and create any missing ones:

ls

PS R:\Flamenco\SheepIt> ls

    Directory: R:\Flamenco\SheepIt

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
d----            7/4/2025 11:59 AM                .specstory
d----            7/4/2025 12:03 PM                cache0
d----            7/4/2025 12:04 PM                cache1
d----            7/4/2025 12:04 PM                cache2
d----            7/4/2025 12:04 PM                temp0
d----            7/4/2025 12:04 PM                temp1
d----            7/4/2025 12:04 PM                temp2
-a---            7/4/2025 11:38 AM       10503011 sheepit-client-7.25182.0.jar

PS R:\Flamenco\SheepIt>

Perfect! All the directories are already created:

  • ✅ cache0, cache1, cache2
  • ✅ temp0, temp1, temp2

It looks like the SheepIt client may have already created these directories when you ran it previously, or they were created during our earlier attempts. All the directories you need for running multiple GPU workers are now ready!

You can now run your three worker scripts (worker0.bat, worker1.bat, worker2.bat) simultaneously without any directory conflicts.

User (2025-07-04 17:59Z)

Where is the SheepIt install location after I ran the sheepit-autoupdate.exe? It doesn't install a program or shortcuts...

Assistant

The SheepIt auto-updater typically installs the client in the same directory where you run it from, or in a subdirectory. Let me help you find where it installed the updated client.

Get-ChildItem -Recurse -Name "*.jar" | Where-Object { $_ -like "*sheepit*" }

PS R:\Flamenco\SheepIt> Get-ChildItem -Recurse -Name "*.jar" | Where-Object { $_ -like "*sheepit*" }        
sheepit-client-7.25182.0.jar
PS R:\Flamenco\SheepIt>

User (2025-07-04 17:59Z)

i ran it from Downloads

Assistant

Ah, that makes sense! If you ran the sheepit-autoupdate.exe from your Downloads folder, it likely installed the updated client there. Let me check your Downloads folder for the SheepIt client:

Get-ChildItem "C:\Users\Nathan\Downloads" -Name "*.jar" | Where-Object { $_ -like "*sheepit*" }

PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Users\Nathan\Downloads" -Name "*.jar" | Where-Object { $_ -like "*
sheepit*" }
PS R:\Flamenco\SheepIt>

Let me check more broadly in your Downloads folder for any SheepIt-related files:

Get-ChildItem "C:\Users\Nathan\Downloads" -Name "*sheepit*" -Recurse

sheepit-autoupdate.exe
PS R:\Flamenco\SheepIt>
PS R:\Flamenco\SheepIt>

Let me check if there are any subdirectories in Downloads that might contain the SheepIt client:

Get-ChildItem "C:\Users\Nathan\Downloads" -Directory


    Directory: C:\Users\Nathan\Downloads

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
PS R:\Flamenco\SheepIt>
PS R:\Flamenco\SheepIt> 
PS R:\Flamenco\SheepIt>

Let me check if the auto-updater might have created a SheepIt folder in your user directory or program files:

Cancelled

User (2025-07-04 17:59Z)

I don't see it.

Assistant

The SheepIt auto-updater might have updated the client in place or created it in a different location. Let me check a few more common places and also see if we can find any recently created SheepIt files:

Get-ChildItem "C:\Program Files" -Name "*sheepit*" -Recurse -ErrorAction SilentlyContinue

PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Users\Nathan" -Name "*sheepit*" -Recurse -ErrorAction SilentlyCont
inue                    Get-ChildItem "C:\Program Files" -Name "*sheepit*" -Recurse -ErrorAction SilentlyCon
tinue
PS R:\Flamenco\SheepIt>

Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction SilentlyContinue

PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*she                                  
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
PS R:\Flamenco\SheepIt> Get-ChildItem "C:\Program Files (x86)" -Name "*sheepit*" -Recurse -ErrorAction Silen
tlyContinue
PS R:\Flamenco\SheepIt>
Reference in New Issue View Git Blame Copy Permalink