dev-python / urlgrabber

Python module for downloading files

Official package sites : http://urlgrabber.baseurl.org · https://github.com/rpm-software-management/urlgrabber ·

A high-level cross-protocol url-grabber. Using urlgrabber, data can be fetched in three basic ways: urlgrab(url) copy the file to the local filesystem urlopen(url) open the remote file and return a file object (like urllib2.urlopen) urlread(url) return the contents of the file as a string When using these functions (or methods), urlgrabber supports the following features: * identical behavior for http://, ftp://, and file:// urls * http keepalive - faster downloads of many files by using only a single connection * byte ranges - fetch only a portion of the file * reget - for a urlgrab, resume a partial download * progress meters - the ability to report download progress automatically, even when using urlopen! * throttling - restrict bandwidth usage * retries - automatically retry a download if it fails. The number of retries and failure types are configurable. * authenticated server access for http and ftp * proxy support - support for authenticated http and ftp proxies * mirror groups - treat a list of mirrors as a single source, automatically switching mirrors if there is a failure.

v4.1.0 :: 0 :: gentoo

Modified
License
LGPL-2.1
Keywords
amd64 ppc ppc64 x86 ~arm ~ia64

python_targets

python3_10
Build with Python 3.10
python3_8
Build with Python 3.8
python3_9
Build with Python 3.9

dev-lang / python : An interpreted, interactive, object-oriented programming language

dev-lang / python-exec : Python script wrapper

dev-python / pycurl : python binding for curl/libcurl

dev-python / setuptools : Collection of extensions to Distutils

dev-python / six : Python 2 and 3 compatibility library

dev-python / urllib3 : HTTP library with thread-safe connection pooling, file post, and more

588060
dev-python/urlgrabber-3.10.1 : ImportError: pycurl: libcurl link-time ssl backend (none/other) is different from compile-time ssl backend (openssl)
Repository mirror & CI · gentoo
Merge updates from master
Arthur Zamarin · gentoo
dev-python/urlgrabber: enable py3.10, use test_network
Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Michał Górny · gentoo
dev-python/urlgrabber: Remove old
Signed-off-by: Michał Górny <mgorny@gentoo.org>
Sam James · gentoo
dev-python/urlgrabber: Stabilize 4.1.0 ALLARCHES, #781806
Signed-off-by: Sam James <sam@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Sam James · gentoo
dev-python/urlgrabber: rebase 4.1.0 on 4.0.0-r1
* Add dev-python/six to BDEPEND * Sort RDEPEND * Move S to below SRC_URI Signed-off-by: Sam James <sam@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Michał Górny · gentoo
dev-python/urlgrabber: Fix dependencies
Closes: https://bugs.gentoo.org/774972 Signed-off-by: Michał Górny <mgorny@gentoo.org>
Wim Muskee · gentoo
dev-python/urlgrabber: version bump to 4.1.0
- add gh upstream id to metadata - add github project url to HOMEPAGE - add explicit DISTUTILS_USE_SETUPTOOLS - add six as RDEPEND - add restricted test phase (internet only) - and patches to let unittests run without failure Closes: https://github.com/gentoo/gentoo/pull/18102 Signed-off-by: Wim Muskee <wimmuskee@gmail.com> Signed-off-by: Sam James <sam@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Michał Górny · gentoo
dev-python/urlgrabber: Remove old (py2)
Signed-off-by: Michał Górny <mgorny@gentoo.org>
Michał Górny · gentoo
dev-python/urlgrabber: Stabilize 4.0.0 ALLARCHES, #735616
Signed-off-by: Michał Górny <mgorny@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Sam James · gentoo
dev-python/urlgrabber: bump to 4.0.0
Bug: https://bugs.gentoo.org/735616 Package-Manager: Portage-3.0.1, Repoman-2.3.23 Signed-off-by: Sam James <sam@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Michał Górny · gentoo
dev-python/urlgrabber: Remove redundant versions
Signed-off-by: Michał Górny <mgorny@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Agostino Sarubbo · gentoo
dev-python/urlgrabber: x86 stable wrt bug #714550
Package-Manager: Portage-2.3.89, Repoman-2.3.20 RepoMan-Options: --include-arches="x86" Signed-off-by: Agostino Sarubbo <ago@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Agostino Sarubbo · gentoo
dev-python/urlgrabber: ppc64 stable wrt bug #714550
Package-Manager: Portage-2.3.89, Repoman-2.3.20 RepoMan-Options: --include-arches="ppc64" Signed-off-by: Agostino Sarubbo <ago@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Agostino Sarubbo · gentoo
dev-python/urlgrabber: amd64 stable wrt bug #714550
Package-Manager: Portage-2.3.89, Repoman-2.3.20 RepoMan-Options: --include-arches="amd64" Signed-off-by: Agostino Sarubbo <ago@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Agostino Sarubbo · gentoo
dev-python/urlgrabber: ppc stable wrt bug #714550
Package-Manager: Portage-2.3.89, Repoman-2.3.20 RepoMan-Options: --include-arches="ppc" Signed-off-by: Agostino Sarubbo <ago@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Michał Górny · gentoo
dev-python: Remove *-fbsd KEYWORDS
Signed-off-by: Michał Górny <mgorny@gentoo.org>
Repository mirror & CI · gentoo
Merge updates from master
Sebastian Pipping · gentoo
dev-python/urlgrabber: Shebang fix + EAPI 7
Signed-off-by: Sebastian Pipping <sping@gentoo.org> Package-Manager: Portage-2.3.50, Repoman-2.3.11
Mikle Kolyada · gentoo
dev-python/urlgrabber: ppc/ppc64 stable wrt bug #653770
Package-Manager: Portage-2.3.24, Repoman-2.3.6
Thomas Deutschmann · gentoo
dev-python/urlgrabber: x86 stable (bug #653770)
Package-Manager: Portage-2.3.31, Repoman-2.3.9
Mikle Kolyada · gentoo
dev-python/urlgrabber: amd64 stable wrt bug #653770
Package-Manager: Portage-2.3.24, Repoman-2.3.6
Robin H. Johnson · gentoo
Drop $Id$ per council decision in bug #611234.
Signed-off-by: Robin H. Johnson <robbat2@gentoo.org>
Robin H. Johnson · gentoo
proj/gentoo: Initial commit
This commit represents a new era for Gentoo: Storing the gentoo-x86 tree in Git, as converted from CVS. This commit is the start of the NEW history. Any historical data is intended to be grafted onto this point. Creation process: 1. Take final CVS checkout snapshot 2. Remove ALL ChangeLog* files 3. Transform all Manifests to thin 4. Remove empty Manifests 5. Convert all stale $Header$/$Id$ CVS keywords to non-expanded Git $Id$ 5.1. Do not touch files with -kb/-ko keyword flags. Signed-off-by: Robin H. Johnson <robbat2@gentoo.org> X-Thanks: Alec Warner <antarus@gentoo.org> - did the GSoC 2006 migration tests X-Thanks: Robin H. Johnson <robbat2@gentoo.org> - infra guy, herding this project X-Thanks: Nguyen Thai Ngoc Duy <pclouds@gentoo.org> - Former Gentoo developer, wrote Git features for the migration X-Thanks: Brian Harring <ferringb@gentoo.org> - wrote much python to improve cvs2svn X-Thanks: Rich Freeman <rich0@gentoo.org> - validation scripts X-Thanks: Patrick Lauer <patrick@gentoo.org> - Gentoo dev, running new 2014 work in migration X-Thanks: Michał Górny <mgorny@gentoo.org> - scripts, QA, nagging X-Thanks: All of other Gentoo developers - many ideas and lots of paint on the bikeshed