Usenet Explorer

Forums
It is currently Sat Dec 04, 2021 11:01 am

All times are UTC




Post new topic Reply to topic  [ 3 posts ] 
Author Message
 Post subject: Maximum number of headers?
PostPosted: Wed Dec 14, 2011 5:59 pm 

Joined: Fri Oct 07, 2005 5:43 pm
Posts: 33
I had a trajedy and lost all my music, so I decided to try to rebuild the collection. I started by getting as many headers as possible for the group alt.binaries.mp3.classic-rock and dropped them into UE - the intent was to delete all files without tags and merely automatically rename and sort them by the tags. I figured this would give me a good starting point - I expected UE to bog down a la Newspro, but after about 5 minutes of complaining it settled down and proceeded to download about 3 terrabytes of files (about 120,000 seperate files, each with multiple parts of course,) at 30 Megabits per second and gracefully allowed me to use the system as usual for other tasks. I figure this was 10 million or more headers.

I would like to do this with Jazz, Blues, and possibly classical, which have considerably more headers. My quesion is, what is the absolute most number of headers I can get, the furthest date I can get, and what settings do I need to change to get it to do this? I assume that Jazz might be as much as 8 or 10 terrabytes. I have a high-end system with an I7 and 8GB ram.

(Newsbin Pro download 10 million headers on a laptop in one fell swoop? Ya, in yer dreams.)


Top
 Profile  
 
 Post subject: Re: Maximum number of headers?
PostPosted: Thu Dec 15, 2011 7:54 am 

Joined: Thu Feb 27, 2003 5:57 pm
Posts: 4461
Use the default compact binary newsgroup type.

To maximize number of headers better to use 64 bit version.

As to marking for download, UE loads information about parts for the whole queue, it means 14M queued headers (parts) take maybe around 1.5GB of RAM, thus maybe to queue some reasonable amount to download at a time.


Top
 Profile  
 
 Post subject: Re: Maximum number of headers?
PostPosted: Sun Dec 25, 2011 2:58 pm 

Joined: Mon Apr 11, 2011 11:05 pm
Posts: 8
I am starting to get more and more errormessages about that i have to decrease retention for big groups, this is an increasing problem, and i would like a way to get the maximum number of headers "automaticaly", if i understood it rigth in another thread there is a databasefile limit on 34Gbyte, this limitation is starting to make problems in many groups as retention increases.
It would be nice if the program deleted the oldest headers or even better if it could handle al headers availible.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

All times are UTC


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group