[PC-BSD Testing] 9.0rc3 - broken 'fetch' AppCafe

[Lars Engels]

I'm also sending this to des@ because he's the author of [lib]fetch.

Am 25.12.2011 04:16, schrieb Tigersharke .:
>
> There seems to be something wrong with fetch, while using curl in 
> place of it works fine.
>
> [tigersharke at Mutant] ~> time curl 
> ftp://ftp.pcbsd.org/pub/mirror/PBI/deskutils/genius/9/x64/genius-1.0.12-amd64.pbi 
> -o "genius-1.0.12-amd64.pbi"
>   % Total    % Received % Xferd  Average Speed   Time    Time     
> Time  Current
>                                  Dload  Upload   Total   Spent    
> Left  Speed
> 100 68.0M  100 68.0M    0     0  1366k      0  0:00:50  0:00:50 
> --:--:-- 1673k
> 0.234u 1.120s 0:51.06 2.6%    164+2822k 0+550io 0pf+0w
> [tigersharke at Mutant] ~> time fetch -v 
> ftp://ftp.pcbsd.org/pub/mirror/PBI/deskutils/genius/9/x64/genius-1.0.12-amd64.pbi
> looking up ftp.pcbsd.org
> connecting to ftp.pcbsd.org:21
> setting passive mode
> opening data connection
> fetch: 
> ftp://ftp.pcbsd.org/pub/mirror/PBI/deskutils/genius/9/x64/genius-1.0.12-amd64.pbi: 
> Operation timed out
> 0.006u 0.000s 1:16.27 0.0%    0+0k 0+0io 0pf+0w
> [tigersharke at Mutant] ~>
>
>
> [tigersharke at Mutant] ~> pbi_listrepo
> [ID]    [Description]
> -----------------------------------------------------
> 001    Official PC-BSD Repository
> [tigersharke at Mutant] ~> pbi_browser
> Using RepoID: 001
> Available Categories:
> ------------------------------------
> Category: Archivers
> Icon: 
> /var/db/pbi/repo-icons/dd3920955c2fcf9bcc66b20dc0d89354-Archivers.png
> Description: Programs for packing/unpacking data archives
>
> ------------------------------------
> <--snip intervening output-->
> ------------------------------------
> Category: X11 - Window Managers
> Icon: /var/db/pbi/repo-icons/dd3920955c2fcf9bcc66b20dc0d89354-X11 - 
> Window Managers.png
> Description: Alternate window managers for the desktop
>
> ------------------------------------
> Category: X11
> Icon: /var/db/pbi/repo-icons/dd3920955c2fcf9bcc66b20dc0d89354-X11.png
> Description: Alternate desktop environments or utilities
>
> To view available PBIs for a particular category:
>  % pbi_browser -c <category> <repoid>
> [tigersharke at Mutant] ~> time pbi_browser -c deskutils 001
> Using RepoID: 001
> Available PBIs for Category: deskutils
> 3.171u 7.268s 0:20.23 51.5%    80+1959k 0+2io 0pf+0w
> [tigersharke at Mutant] ~>
>
> ^C[tigersharke at Mutant] ~> ls /var/db/pbi/index
> .
> ..
> dd3920955c2fcf9bcc66b20dc0d89354-index
> dd3920955c2fcf9bcc66b20dc0d89354-index.time
> dd3920955c2fcf9bcc66b20dc0d89354-meta
> [tigersharke at Mutant] ~>

[...]

>
> Further testing and investigation has given me some insight, a
> work-around, but no solution to the real issue.
>
> FTP_PASSIVE_MODE environment is set to YES inside of both pbi_add and
> pc-updatemanager, which explains why setting the environment variable
> outside has no effect.
>
> workaround:
>
> locate FTP_PASSIVE_MODE inside pbi_add and pc-updatemanager then
> switch it to a value of NO
>
> Three things:
>
> 	* Why is passive mode necessary?

Because it should just work nowadays. :)
Active mode needs two ports: tcp/21 and tcp/20. One for the control 
protocol and one for the
actual data. For active mode the server needs to initiate a connection 
to the client which
doesn't work easily for NATted clients, so mostly passive mode is used.

>  	* What caused passive mode to be disabled or broken on the ftp
> site(s)?

I don't know but I've also seen this before. IIRC there was a change in 
libfetch about active/passive
mode.

DES: Do you know why this can fail?

> 	* Could the passive mode setting be moved to pcbsd.conf which
> pc-updatemanager already reads?

Good idea!