Setup<\/h2>\n\n\n\n- Create a new Jupyter Notebook and name it Document_Automation<\/li><\/ol>\n\n\n\n
![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image.png\")
<\/figure>\n\n\n\n- Create a new folder on your C Drive \u201cC:\\Python\\Automation\u201d and seed it with 10 empty files that follow the naming conventin file_YYYYMMDD and log_YYYYMMDD. Create two folders called \u201cFiles\u201d and \u201cLogs\u201d<\/li><\/ul>\n\n\n\n
![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-1.png\")
<\/figure>\n\n\n\nSetup<\/h2>\n\n\n\n- <\/li>
- The following command will list out all text files located in the folder you are searching for and place the date in to a list called \u201cmylist\u201d. The \u201c*\u201d is a wildcard that allows you to search for all character combinations that end with \u201c.txt\u201d. This can be updated to look for other file types<\/li><\/ul>\n\n\n\n
import glob\nmylist = glob.glob(\"C:\/Python\/Automation\/*.txt\")\nprint(mylist)<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-2.png\")
<\/figure>\n\n\n\n- Next we can try to create our folders where we will organize our files. Since we already created them, the try\/catch will fail but if you had deleted them you will see them reappear. The OS and shutil need to be imported for these commands to work<\/li><\/ul>\n\n\n\n
import os, shutil\ntry: \n os.mkdir(\"C:\/Python\/Automation\/Files\")\n os.mkdir(\"C:\/Python\/Automation\/Files\")\nexcept OSError:\n print (\"Folder Creation Failed\")\nelse:\n print (\"Folder Creation Success\")\n<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-3.png\")
<\/figure>\n\n\n\n<\/p>\n\n\n\n
- Start with a loop to go through your list<\/li><\/ul>\n\n\n\n
for i in mylist: \n print(i)<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-4.png\")
<\/figure>\n\n\n\n- Lets update the look to search for any \u201clog\u201d\nfirst. This can be done with a string startswith()<\/a>\ncommand or using the \u201cin<\/a>\u201d command with\nan If statement. Both work in the case but be careful if your file naming rules\ncan change. We will use the latter example for the rest of the tutorial.<\/li><\/ul>\n\n\n\n
for i in mylist: \n if (i.startswith('C:\/Python\/Automation\\log_')):\n print(i)\n\nfor i in mylist: \n if (\"log\" in i):\n print(i)\n<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-5.png\")
<\/figure>\n\n\n\n<\/p>\n\n\n\n
- Now move the files found in the search to the destination folder using the Move<\/a> command. We need to specify the source location and destination location so we use Replace<\/a> string manipulation to create both of those strings to pass to the function. Once run, you will see the files moved to the respective folders. <\/li><\/ul>\n\n\n\n
for i in mylist: \n if (\"log\" in i):\n #print(i)\n source = i\n destination = i.replace('C:\/Python\/Automation', 'C:\/Python\/Automation\/Logs') \n shutil.move(source, destination)<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-6.png\")
<\/figure>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-7.png\")
<\/figure>\n\n\n\n- We can now do the same with the files titled \u201cFiles\u201d<\/li><\/ul>\n\n\n\n
for i in mylist: \n if (\"file\" in i):\n #print(i)\n source = i\n destination = i.replace('C:\/Python\/Automation', 'C:\/Python\/Automation\/Files') \n shutil.move(source, destination)\n<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-8.png\")
<\/figure>\n\n\n\n<\/p>\n\n\n\n
Cleaning out old Files <\/h2>\n\n\n\n- Finally, we want to delete any old files. We can\ndo this using the remove and time functions in Python to identify the last modified\ntime of the file. In this sample 1800 is 30 minutes in seconds. This can be\nadjusted to make the window longer or a few days. We need to import time and sys\nto be able to the correct commands. Uncomment the If statement to use parameters\non the time duration.<\/li><\/ul>\n\n\n\n
import os, time, sys\n\npath = r'C:\/Python\/Automation\/Logs'\n\nnow = time.time()\n\nfor f in os.listdir(path):\n #if os.stat(os.path.join(path,f)).st_mtime < now - 7 * 86400:\n if os.stat(os.path.join(path,f)).st_mtime < now:\n print(\"Removing File\")\n os.remove(os.path.join(path,f))<\/code><\/pre>\n\n\n\n![\"\"](\"http:\/\/jackofalltradesmasterofsome.com\/blog\/wp-content\/uploads\/2020\/05\/image-9.png\")
<\/figure>\n\n\n\nCheck out my these Udemy Classes below to get started in Python<\/p>\n\n\n\n
And Other articles here below.<\/p>\n\n\n\n
Robotic Python Automation Files Cleaning Sorting and Archiving<\/p>\n","protected":false},"excerpt":{"rendered":"
Robotic Python Automation Files Cleaning Sorting and Archiving. Sometimes we have folders where files are saved that get out of control. Sometimes we have Excel documents or Work files that pile up and we need an efficient way to sift and sort through them and either archive files or delete them. Using Python, we can […]<\/p>\n","protected":false},"author":1,"featured_media":807,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[97,94],"tags":[8,98],"class_list":["post-792","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-automation","category-python","tag-automation","tag-python"],"_links":{"self":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/comments?post=792"}],"version-history":[{"count":12,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792\/revisions"}],"predecessor-version":[{"id":816,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792\/revisions\/816"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media\/807"}],"wp:attachment":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media?parent=792"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/categories?post=792"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/tags?post=792"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
<\/figure>\n\n\n\n- Create a new folder on your C Drive \u201cC:\\Python\\Automation\u201d and seed it with 10 empty files that follow the naming conventin file_YYYYMMDD and log_YYYYMMDD. Create two folders called \u201cFiles\u201d and \u201cLogs\u201d<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
Setup<\/h2>\n\n\n\n
- <\/li>
- The following command will list out all text files located in the folder you are searching for and place the date in to a list called \u201cmylist\u201d. The \u201c*\u201d is a wildcard that allows you to search for all character combinations that end with \u201c.txt\u201d. This can be updated to look for other file types<\/li><\/ul>\n\n\n\n
import glob\nmylist = glob.glob(\"C:\/Python\/Automation\/*.txt\")\nprint(mylist)<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n- Next we can try to create our folders where we will organize our files. Since we already created them, the try\/catch will fail but if you had deleted them you will see them reappear. The OS and shutil need to be imported for these commands to work<\/li><\/ul>\n\n\n\n
import os, shutil\ntry: \n os.mkdir(\"C:\/Python\/Automation\/Files\")\n os.mkdir(\"C:\/Python\/Automation\/Files\")\nexcept OSError:\n print (\"Folder Creation Failed\")\nelse:\n print (\"Folder Creation Success\")\n<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n<\/p>\n\n\n\n
- Start with a loop to go through your list<\/li><\/ul>\n\n\n\n
for i in mylist: \n print(i)<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n- Lets update the look to search for any \u201clog\u201d\nfirst. This can be done with a string startswith()<\/a>\ncommand or using the \u201cin<\/a>\u201d command with\nan If statement. Both work in the case but be careful if your file naming rules\ncan change. We will use the latter example for the rest of the tutorial.<\/li><\/ul>\n\n\n\n
for i in mylist: \n if (i.startswith('C:\/Python\/Automation\\log_')):\n print(i)\n\nfor i in mylist: \n if (\"log\" in i):\n print(i)\n<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n<\/p>\n\n\n\n
- Now move the files found in the search to the destination folder using the Move<\/a> command. We need to specify the source location and destination location so we use Replace<\/a> string manipulation to create both of those strings to pass to the function. Once run, you will see the files moved to the respective folders. <\/li><\/ul>\n\n\n\n
for i in mylist: \n if (\"log\" in i):\n #print(i)\n source = i\n destination = i.replace('C:\/Python\/Automation', 'C:\/Python\/Automation\/Logs') \n shutil.move(source, destination)<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\n- We can now do the same with the files titled \u201cFiles\u201d<\/li><\/ul>\n\n\n\n
for i in mylist: \n if (\"file\" in i):\n #print(i)\n source = i\n destination = i.replace('C:\/Python\/Automation', 'C:\/Python\/Automation\/Files') \n shutil.move(source, destination)\n<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\n<\/p>\n\n\n\n
Cleaning out old Files <\/h2>\n\n\n\n
- Finally, we want to delete any old files. We can\ndo this using the remove and time functions in Python to identify the last modified\ntime of the file. In this sample 1800 is 30 minutes in seconds. This can be\nadjusted to make the window longer or a few days. We need to import time and sys\nto be able to the correct commands. Uncomment the If statement to use parameters\non the time duration.<\/li><\/ul>\n\n\n\n
import os, time, sys\n\npath = r'C:\/Python\/Automation\/Logs'\n\nnow = time.time()\n\nfor f in os.listdir(path):\n #if os.stat(os.path.join(path,f)).st_mtime < now - 7 * 86400:\n if os.stat(os.path.join(path,f)).st_mtime < now:\n print(\"Removing File\")\n os.remove(os.path.join(path,f))<\/code><\/pre>\n\n\n\n<\/figure>\n\n\n\nCheck out my these Udemy Classes below to get started in Python<\/p>\n\n\n\n
And Other articles here below.<\/p>\n\n\n\n
Robotic Python Automation Files Cleaning Sorting and Archiving<\/p>\n","protected":false},"excerpt":{"rendered":"
Robotic Python Automation Files Cleaning Sorting and Archiving. Sometimes we have folders where files are saved that get out of control. Sometimes we have Excel documents or Work files that pile up and we need an efficient way to sift and sort through them and either archive files or delete them. Using Python, we can […]<\/p>\n","protected":false},"author":1,"featured_media":807,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[97,94],"tags":[8,98],"class_list":["post-792","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-automation","category-python","tag-automation","tag-python"],"_links":{"self":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/comments?post=792"}],"version-history":[{"count":12,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792\/revisions"}],"predecessor-version":[{"id":816,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/posts\/792\/revisions\/816"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media\/807"}],"wp:attachment":[{"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/media?parent=792"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/categories?post=792"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jackofalltradesmasterofsome.com\/blog\/wp-json\/wp\/v2\/tags?post=792"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
- Finally, we want to delete any old files. We can\ndo this using the remove and time functions in Python to identify the last modified\ntime of the file. In this sample 1800 is 30 minutes in seconds. This can be\nadjusted to make the window longer or a few days. We need to import time and sys\nto be able to the correct commands. Uncomment the If statement to use parameters\non the time duration.<\/li><\/ul>\n\n\n\n
- We can now do the same with the files titled \u201cFiles\u201d<\/li><\/ul>\n\n\n\n
- Now move the files found in the search to the destination folder using the Move<\/a> command. We need to specify the source location and destination location so we use Replace<\/a> string manipulation to create both of those strings to pass to the function. Once run, you will see the files moved to the respective folders. <\/li><\/ul>\n\n\n\n
- Lets update the look to search for any \u201clog\u201d\nfirst. This can be done with a string startswith()<\/a>\ncommand or using the \u201cin<\/a>\u201d command with\nan If statement. Both work in the case but be careful if your file naming rules\ncan change. We will use the latter example for the rest of the tutorial.<\/li><\/ul>\n\n\n\n
- Start with a loop to go through your list<\/li><\/ul>\n\n\n\n
- Next we can try to create our folders where we will organize our files. Since we already created them, the try\/catch will fail but if you had deleted them you will see them reappear. The OS and shutil need to be imported for these commands to work<\/li><\/ul>\n\n\n\n