Klauda Lab Simulation Wiki

User Tools

Site Tools

Trace:
Writing /users/jbklauda/pub/wiki/data/cache/6/6193a558dc90ed4c190004bf67ecff70.captchaip failed
simulating_hydrocarbon_mixtures

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
simulating_hydrocarbon_mixtures [2018/01/12 16:27] – editsimulating_hydrocarbon_mixtures [2018/05/31 14:13] (current) – admin
Line 1: Line 1:
-**(Page is under construction. Editing in progress)** 
  
-**(The files mention below can be found at https://drive.google.com/open?id=1qmC5TQ3FDq8wyrmsUgUDqWiH1e87Yflt )**+**(The files mention below can be found at here {{instructions_manual.zip}} )**
  
 **__A) Generating the required files for a molecule (Example: Cyclohexane)__** **__A) Generating the required files for a molecule (Example: Cyclohexane)__**
Line 40: Line 39:
  
  
-**__C) How to Access Deep Thought 1 (DT1)__**+**__C) How to Access Deepthought2 (DT2)__**
  
  1. Download WinSCP from https://winscp.net/eng/download.php \\   1. Download WinSCP from https://winscp.net/eng/download.php \\ 
  -- WinSCP allows you to upload files to and download files from Deep Thought 1 \\  -- WinSCP allows you to upload files to and download files from Deep Thought 1 \\
  2. Open WinSCP and log-in using: \\  2. Open WinSCP and log-in using: \\
-    Host name: login.deepthought.umd.edu +    Host name: login.deepthought2.umd.edu 
     Port number: 22      Port number: 22 
-    User name: universityID  this is your university id (not id number) +    User name: universityID             <- this is your university id (not id number) 
     Password: ‘your university password’      Password: ‘your university password’ 
  -- Server files will appear on the right side and your local files will appear on the left. \\  -- Server files will appear on the right side and your local files will appear on the left. \\
Line 55: Line 54:
  -- Putty allows you to access Deep Thought 1 via a console and execute scripts \\  -- Putty allows you to access Deep Thought 1 via a console and execute scripts \\
  5. Open Putty and log-in using: \\  5. Open Putty and log-in using: \\
-    Host Name: login.deepthought.umd.edu +    Host Name: login.deepthought2.umd.edu 
     Port: 22      Port: 22 
     Click “Open”      Click “Open” 
Line 62: Line 61:
  -- When you first login, you will be in the “lustre/home/universityID” folder on the server.\\  -- When you first login, you will be in the “lustre/home/universityID” folder on the server.\\
  6. Type “source startup.csh” to execute the script you previously uploaded \\  6. Type “source startup.csh” to execute the script you previously uploaded \\
-**  The previous step must be done every time you login into DT1** \\+** -- The previous step must be done every time you login into DT2** \\
  -- The startup.csh script assigns the location of the 2 programs: Packmol and CHARMM to the environment variables “$packmol” and “$charmm”, respectively. This will ease the execution of future scripts. \\  -- The startup.csh script assigns the location of the 2 programs: Packmol and CHARMM to the environment variables “$packmol” and “$charmm”, respectively. This will ease the execution of future scripts. \\
     (see startup.csh)     (see startup.csh)
Line 69: Line 68:
 **__D) Packing a Mixture of Water and Cyclohexane__** **__D) Packing a Mixture of Water and Cyclohexane__**
  
- 1. In WinSCP, navigate to “lustre/universityID” on DT1 and create a folder called “packing” \\+ 1. In WinSCP, navigate to “lustre/universityID” on DT2 and create a folder called “packing” \\
  -- (to create a folder, look for the   icon on the right side of the screen) \\  -- (to create a folder, look for the   icon on the right side of the screen) \\
- 2. Transfer “cyclohexane/cyclohexane2.pdb” and “water/water.pdb” to this folder on DT1 \\ + 2. Transfer “cyclohexane/cyclohexane2.pdb” and “water/water.pdb” to this folder on DT2 \\ 
- 3. Transfer the packmol script “packing/packing.inp” to the “packing” folder on DT1 \\+ 3. Transfer the packmol script “packing/packing.inp” to the “packing” folder on DT2 \\
  4. The packmol script is explained via comments inside the file. \\  4. The packmol script is explained via comments inside the file. \\
  5. In Putty, navigate to “lustre/universityID/packing” \\  5. In Putty, navigate to “lustre/universityID/packing” \\
Line 79: Line 78:
     chmod 700 packing.inp     chmod 700 packing.inp
     $packmol < packing.inp > packing.out     $packmol < packing.inp > packing.out
- -- This should result in two new files being generated in the “packing” folder on DT1  \\+ -- This should result in two new files being generated in the “packing” folder on DT2  \\
  -- (you might need to Refresh   to see the new files) \\  -- (you might need to Refresh   to see the new files) \\
  -- One of the files will be called “packing.out” which outlines the progress of Packmol as it packs the mixture. The other file will be called “mixture.pdb” which will contain the packed mixture. If the “mixture.pdb” file was not generated, then an error occurred while packing. You will need to read “packing.out” to understand and correct the error.  \\  -- One of the files will be called “packing.out” which outlines the progress of Packmol as it packs the mixture. The other file will be called “mixture.pdb” which will contain the packed mixture. If the “mixture.pdb” file was not generated, then an error occurred while packing. You will need to read “packing.out” to understand and correct the error.  \\
Line 90: Line 89:
 **__E) Generating a .psf file for the mixture__** **__E) Generating a .psf file for the mixture__**
  
-Now that we have packed the mixture, the next step is to generate a .psf file for the mixture. This .psf file “contains all of the molecule-specific information needed to apply a particular force field to a molecular system”[1}. We will use CHARMM to generate this file. +-- Now that we have packed the mixture, the next step is to generate a .psf file for the mixture. This .psf file “contains all of the molecule-specific information needed to apply a particular force field to a molecular system”(http://www.ks.uiuc.edu/Training/Tutorials/namd/namd-tutorial-unix-html/node23.html). We will use CHARMM to generate this file. \\
-In WinSCP, navigate to “lustre/universityID” on DT1 and create a folder called “generatingPSF”. +
-In WinSCP, drag the following into the “generatingPSF” folder: +
-water/top_tip4p_2005.rtf +
-water/par_tip4p_2005.prm +
-cyclohexane/cyclohexane.rtf +
-cyclohexane/cyclohexane.prm               <- not necessary, reason explained in CHARMM script +
-packing/mixture.pdb +
-generatingPSF/top_all36_cgenff.rtf       <- contains the topology of common molecules +
-generatingPSF/par_all36_cgenff.prm    <- contains the interaction parameters for common molecules +
-generatingPSF/generatingPSF.inp          <- contains CHARMM script for generating the .psf file+
  
-(these should be the only files in the “generatingPSF” folder before running the CHARMM script) + 1. In WinSCP, navigate to “lustre/universityID” on DT2 and create a folder called “generatingPSF”. \\ 
-(the CHARMM script is explained via comments inside the file) + 2. In WinSCP, drag the following into the “generatingPSF” folder: \\ 
-In Putty, navigate to “lustre/universityID/generatingPSF” +    water/top_tip4p_2005.rtf 
-To run CHARMM on your CHARMM script, type the following into the console: +    water/par_tip4p_2005.prm 
-dos2unix generatingPSF.inp +    cyclohexane/cyclohexane.rtf 
-chmod 700 generatingPSF.inp +    cyclohexane/cyclohexane.prm              <- not necessary, reason explained in CHARMM script 
-$charmm < generatingPSF.inp > generatingPSF.out +    packing/mixture.pdb 
-This should result in three new files being generated in the “generatingPSF” folder on DT1: +    generatingPSF/top_all36_cgenff.rtf       <- contains the topology of common molecules 
-(if this is not the case, check the generatingPSF.out file to understand and correct any errors) +    generatingPSF/par_all36_cgenff.prm       <- contains the interaction parameters for common molecules 
-mixture_charmm.pdb    <- coordinates of our mixture generated by CHARMM +    generatingPSF/generatingPSF.inp          <- contains CHARMM script for generating the .psf file
-mixture_charmm.psf     <- interaction parameters of our mixture generated by CHARMM +
-generatingPSF.out          <- details the progress of CHARMM as it executes the input script +
-Even if all three files are generated, this does not mean the CHARMM script executed properly.  +
-Perform a visual check of the “mixture_charmm.pdb” file. Open “mixture_charmm.pdb” in WordPad and scroll through to the bottom. If any of the atoms have “9999.000” for their x,y,z coordinates, then an error has occurred. Check the generatingPSF.out file to understand and correct the error. +
-Now we are ready to run a simulation!!!+
  
 + -- (these should be the only files in the “generatingPSF” folder before running the CHARMM script) \\
 + -- (the CHARMM script is explained via comments inside the file) \\
  
-1) http://www.ks.uiuc.edu/Training/Tutorials/namd/namd-tutorial-unix-html/node23.html+ 3. In Putty, navigate to “lustre/universityID/generatingPSF” \\ 
 + 4. To run CHARMM on your CHARMM script, type the following into the console: \\ 
 +    dos2unix generatingPSF.inp 
 +    chmod 700 generatingPSF.inp 
 +    $charmm < generatingPSF.inp > generatingPSF.out 
 + -- This should result in three new files being generated in the “generatingPSF” folder on DT2: \\ 
 + -- (if this is not the case, check the generatingPSF.out file to understand and correct any errors) \\ 
 +    mixture_charmm.pdb         <- coordinates of our mixture generated by CHARMM 
 +    mixture_charmm.psf         <- interaction parameters of our mixture generated by CHARMM 
 +    generatingPSF.out          <- details the progress of CHARMM as it executes the input script
  
-Running a Simulation + -- Even if all three files are generated, this does not mean the CHARMM script executed properly.  \\
-We will use NAMD to run our simulations. You need to provide NAMD with your mixture system (pdb, psf, prm files) along with an input script, that outlines simulation parameters (temperature, pressure, duration, among other things). After you have gathered all the necessary files, you submit these files along with instructions to Slurm. Slurm is the system that will assign you a node on the DT cluster for your simulation to run.  +
-There are two parts to running a simulation. The first part is a short (1 ns) simulation to allow the mixture to reach equilibrium. The second part an extended simulation where you can observe how your system behaves. The second part is usually done in chunks. For example, first, you simulate your system for 10 ns. After that simulation ends, you use the positions and velocities of the molecules at the end of the simulation to start another simulation for another 10ns, thus extending the simulation for another 10ns, and so on. This is done so that it is easier manage and analyze the output files generated by NAMD. Note: This short (1ns) equilibrium simulation requires a different set of simulation parameters than the extended simulations. +
-First, let’s run the short (1ns) simulation: +
-In WinSCP, navigate to “lustre/universityID” on DT1 and create a folder called “runningSim”. +
-In this folder, create another folder called “equalize”. +
-In WinSCP, drag the following into the “equalize” folder: +
-generatingPSF/par_all36_cgenff.prm +
-generatingPSF/par_tip4p_2005.prm +
-generatingPSF/mixture_charmm.pdb +
-generatingPSF/mixture_charmm.psf +
-runningSim/equalize/runningSim.inp                     <- NAMD input script with simulation parameters +
-runningSim/equalize/slurmInstructions.csh          <- Instructions for Slurm to run your simulation on DT1 +
-(these should be the only files in the “equalize” folder before submitting the job to Slurm) +
-( See comments inside “runningSim.inp” and “slurmInstructions.csh” ) +
-( To learn more about NAMD simulation parameters and for a full explanation of “runningSim.inp”, see http://www.ks.uiuc.edu/Research/namd/2.9/ug/node9.html ) +
-( For a full explanation of “slurmInstructions.csh”, see https://www.glue.umd.edu/hpcc/help/jobs.moab-torque.html ) +
-( To learn more about Slurm and how to monitor or cancel a job submitted to Slurm, see https://www.glue.umd.edu/hpcc/help/managing.html )+
  
 + 5. Perform a visual check of the “mixture_charmm.pdb” file.  \\
 + -- Open “mixture_charmm.pdb” in WordPad and scroll through to the bottom.  \\
 + -- If any of the atoms have “9999.000” for their x,y,z coordinates, then an error has occurred. Check the generatingPSF.out file to understand and correct the error. \\
  
 + -- Now we are ready to run a simulation!!! \\
  
  
 +**__F) Running a Simulation__** 
  
-In Putty, navigate to “lustre/universityID/runningSim/equalize” +-- We will use NAMD to run our simulations. You need to provide NAMD with your mixture system (pdb, psf, prm files) along with an input script, that outlines simulation parameters (temperature, pressure, duration, among other things). After you have gathered all the necessary files, you submit these files along with instructions to Slurm. Slurm is the system that will assign you a node on the Deep Thought 1 cluster for your simulation to run.  
-To submit your job to Slurm, type the following into the console: +There are two parts to running a simulation. The first part is a short (1 ns) simulation to allow the mixture to reach equilibrium. The second part is an extended simulation where you can observe how your system behaves. The second part is usually done in chunks. For example, first, you simulate your system for 10 ns. After that simulation ends, you use the positions and velocities of the molecules at the end of the simulation to start another simulation for another 10ns, thus extending the simulation for another 10ns, and so on. This is done so that it is easier manage and analyze the output files generated by NAMD. Note: This short (1ns) equilibrium simulation requires a different set of simulation parameters than the extended simulations. \\ 
-dos2unix slurmInstructions.csh +
-chmod 700 slurmInstructions.csh +
-sbatch -A energybio-hi slurmInstructions.csh +
-If the job submission is successful, you should see “Submitted batch job ######” in the console. +
-To view all jobs that you are running on DT1, type “squeue -u universityID” into the console. +
-Tracking your simulation +
-The file “runningSim.out” will be generated in the “equalize” folder that will outline the progress of the simulation. After all the files have been read and the simulation has begun, you will start to see estimates of time remaining until the simulation is complete in “runningSim.out”. A few other files will be generated as well. The file that will allow you to watch the progression of your simulation is the .dcd file. Snapshots of your system are taken periodically and added to this dcd file. While the simulation is running, the dcd file should be increasing in size. To view these snapshots, we will use VMD: +
-Transfer “runningSim/equalize/mixture_charmm.psf” from DT1 to your machine +
-Transfer “runningSim/equalize/mixture_prod.dcd” from DT1 to your machine +
-Open VMD +
-Click File > New Molecule… > Browse > navigate to and select “mixture_charmm.psf” > Ok > Load +
-Next, Click Browse > navigate to and select “mixture_prod.dcd” > ok > Load +
-Your mixture should appear in the VMD Display window. In the VMD main window, you will see a sliding bar along the bottom. This slide bar lets you navigate to certain snapshots (the snapshots are in chronological order). Play around with the controls below this slide bar to understand how they work. +
  
-Once your equilibrium simulation is complete, you can begin to run extended simulations on your mixture.+__First, let’s run the short (1ns) simulation:__ \\ 
  
 + 1. In WinSCP, navigate to “lustre/universityID” on DT2 and create a folder called “runningSim”. \\ 
 + 2. In this folder, create another folder called “equalize”. \\ 
 + 3. In WinSCP, drag the following into the “equalize” folder: \\ 
 +    generatingPSF/par_all36_cgenff.prm
 +    generatingPSF/par_tip4p_2005.prm
 +    generatingPSF/mixture_charmm.pdb
 +    generatingPSF/mixture_charmm.psf
 +    runningSim/equalize/runningSim.inp                     <- NAMD input script with simulation parameters
 +    runningSim/equalize/slurmInstructions.csh              <- Instructions for Slurm to run your simulation on DT2
 + -- (these should be the only files in the “equalize” folder before submitting the job to Slurm) \\ 
 + -- (See comments inside “runningSim.inp” and “slurmInstructions.csh”) \\ 
 + -- (To learn more about NAMD simulation parameters and for a full explanation of “runningSim.inp”, see http://www.ks.uiuc.edu/Research/namd/2.9/ug/node9.html) \\ 
 + -- (For a full explanation of “slurmInstructions.csh”, see https://www.glue.umd.edu/hpcc/help/jobs.moab-torque.html) \\ 
 + -- (To learn more about Slurm and how to monitor or cancel a job submitted to Slurm, see https://www.glue.umd.edu/hpcc/help/managing.html) \\ 
  
 + 4. In Putty, navigate to “lustre/universityID/runningSim/equalize” \\ 
 + 5. To submit your job to Slurm, type the following into the console: \\ 
 +    dos2unix slurmInstructions.csh
 +    chmod 700 slurmInstructions.csh
 +    sbatch -A energybio-hi slurmInstructions.csh
 + -- If the job submission is successful, you should see “Submitted batch job ######” in the console. \\ 
 + -- To view all jobs that you are running on DT2, type “squeue -u universityID” into the console. \\ 
  
 +__Tracking your simulation:__  \\ 
  
 +-- The file “runningSim.out” will be generated in the “equalize” folder that will outline the progress of the simulation. After all the files have been read and the simulation has begun, you will start to see estimates of time remaining until the simulation is complete in “runningSim.out”. A few other files will be generated as well. The file that will allow you to watch the progression of your simulation is the .dcd file. Snapshots of your system are taken periodically and added to this dcd file. While the simulation is running, the dcd file should be increasing in size. To view these snapshots, we will use VMD: 
  
 + 6. Transfer “runningSim/equalize/mixture_prod.dcd” from DT2 to your machine \\
 + 7. Transfer “runningSim/equalize/mixture_charmm.psf” from DT2 to your machine \\ 
 + 8. Open VMD \\
 + 9. Click File > New Molecule… > Browse > navigate to and select “mixture_charmm.psf” > Ok > Load \\
 +10. Next, Click Browse > navigate to and select “mixture_prod.dcd” > ok > Load \\
  
 + -- Your mixture should appear in the VMD Display window. In the VMD main window, you will see a sliding bar along the bottom. This slide bar lets you navigate to certain snapshots (the snapshots are in chronological order).\\
 + -- Play around with the controls below this slide bar to understand how they work. \\
 + -- Once your equilibrium simulation is complete, you can begin to run extended simulations on your mixture. \\ 
  
 +__Running Extended Simulations:__  \\
  
 +11. In WinSCP, navigate to the “runningSim” folder on DT2 and create a folder called “sim1”. \\ 
 +12. In WinSCP, drag the following into the “sim1” folder: \\
 +    runningSim/equalize/mixture_prod.coor
 +    runningSim/equalize/mixture_prod.vel
 +    runningSim/equalize/mixture_prod.xsc
 +    runningSim/equalize/par_all36_cgenff.prm
 +    runningSim/equalize/par_tip4p_ew.prm
 +    runningSim/equalize/mixture_charmm.pdb
 +    runningSim/equalize/mixture_charmm.psf
 +    runningSim/sim1/slurmInstructions1.csh          <- slightly different for an extended simulation
 +    runningSim/sim1/runningSim1.inp                 <- Contains NAMD parameters for an extended simulation which differ from parameters for the equilibrium simulation
 + -- (See comments inside “runningSim.inp” and “slurmInstructions.csh”) \\
 + -- The process for submitting a job is the same:  \\
 + 
 +13. In Putty, navigate to “lustre/universityID/runningSim/sim1” \\
 +14. To submit your job to Slurm, type the following into the console:  \\
 +    dos2unix slurmInstructions1.csh
 +    chmod 700 slurmInstructions1.csh
 +    sbatch -A energybio-hi slurmInstructions1.csh
 + -- If the job submission is successful, you should see “Submitted batch job ######” in the console.  \\
 + -- To view all jobs that you are running on DT2, type “squeue -u universityID” into the console. \\
  
 +-- Once the first simulation finishes running, you transfer the output the “.coor”,”.vel” and “.xsc” files generated by this simulation to a new folder, along with the other necessary files. You must tweek "runningSim1.inp" and "slurmInstructions1.csh" to account for the different file input and output names and then you run the extended simulation again. I’ve included an example of this process in the “runningSim/sim2” folder. Review the files “runningSim2.inp” and “slurmInstructions2.inp” to see the tweeks that must be made to start this simulation from where the first simulation ended. \\
  
-Running Extended Simulations +If you have any question, feel free to email me at kmanayer(at)yahoo(dot)com  \\
-In WinSCP, navigate to the “runningSim” folder on DT1 and create a folder called “sim1”. +
-In WinSCP, drag the following into the “sim1” folder: +
-runningSim/equalize/mixture_prod.coor +
-runningSim/equalize/mixture_prod.vel +
-runningSim/equalize/mixture_prod.xsc +
-runningSim/equalize/par_all36_cgenff.prm +
-runningSim/equalize/par_tip4p_ew.prm +
-runningSim/equalize/mixture_charmm.pdb +
-runningSim/equalize/mixture_charmm.psf +
-runningSim/sim1/slurmInstructions1.csh      <- slightly different for an extended simulation +
-runningSim/sim1/runningSim1.inp                 <- Contains NAMD parameters for an extended simulation +
-                        which differ from parameters for the equilibrium simulation +
-( See comments inside “runningSim.inp” and “slurmInstructions.csh” ) +
-The process for submitting a job is the same: +
-In Putty, navigate to “lustre/universityID/runningSim/sim1” +
-To submit your job to Slurm, type the following into the console: +
-dos2unix slurmInstructions1.csh +
-chmod 700 slurmInstructions1.csh +
-sbatch -A energybio-hi slurmInstructions1.csh +
-If the job submission is successful, you should see “Submitted batch job ######” in the console. +
-To view all jobs that you are running on DT1, type “squeue -u universityID” into the console. +
- +
-Once the first simulation finishes running, you transfer the output the “.coor”,”.vel” and “.xsc” files generated by this simulation to a new folder, along with the other necessary files. You must tweek runningSim1.inp and slurmInstructions1.csh to account for the different file input and output names and then you run the extended simulation again. I’ve included an example of this process in the “runningSim/sim2” folder. Review the files “runningSim2.inp” and “slurmInstructions2.inp” to see the tweeks that must be made to start this simulation from where the first simulation ended. +
- +
- +
-This is the end of part 2. I will work on a guide for the program I used to create the hydrate crystal that are needed for hydrate simulations. If you have any question, feel free to email me at kmanayer at yahoo dot com +
  
simulating_hydrocarbon_mixtures.1515792475.txt.gz · Last modified: 2018/01/12 16:27 by edit