Changeset 93cd0a4

Timestamp:

02/24/12 09:28:21 (16 months ago)

Author:

Aurélien Bompard <aurelien@…>

Branches:

master

Children:

09c31f2

Parents:

d949443

git-author:

Aurélien Bompard <aurelien@…> (02/24/12 09:28:21)

git-committer:

Aurélien Bompard <aurelien@…> (02/24/12 09:28:21)

Message:

rss-mirror: add an option to keep downloaded pages

File:

• rss-mirror.py (modified) (4 diffs)

rss-mirror.py

@@ -422 +422 @@
 
 
-    def cleanup(self):
+    def remove_expired(self):
         """
         Remove mirrored pages which are not in the feed anymore (probably
@@ -434 +434 @@
             if not config.getboolean("DEFAULT", "debug"):
                 shutil.rmtree(os.path.join(self.path, dirname))
+
+    def cleanup(self):
         self.lowercase_dirs()
         if "_iui" not in os.listdir(self.path):
@@ -546 +548 @@
                       "pages until this depth. Be careful with that. "
                       "Default: %default)")
+    parser.add_option("-k", "--keep", action="store_true",
+                      help="Keep the previously downloaded pages even if "
+                           "they were removed from the feed")
     parser.add_option("-d", "--debug", dest="debug", action="store_true",
                       help="Debug mode")
@@ -632 +637 @@
 
     repo.make_index(downloader)
+    if not options.keep:
+        repo.remove_expired()
     repo.cleanup()