http hangs, https not, following ubuntu build from scratch.

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

http hangs, https not, following ubuntu build from scratch.

James Northrup
I have been having to wrap http in -i <( curl URL) using head ffmpeg on
ubuntu 19

i want to know if there is a configure switch i might've used that creates
a situation where http is buggered.  i have two such ubuntu 19 machines
with similar results.

jim@jim-Predator-PO9-900:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu Disco Dingo (development branch)
Release:        19.04
Codename:       disco

jim@jim-Predator-PO9-900:~$ ffmpeg -i
http://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c92
-d3441339c3f2.mp3
ffmpeg version N-93395-g15d016b Copyright (c) 2000-2019 the FFmpeg
developers
 built with gcc 8 (Ubuntu 8.3.0-3ubuntu1)
 configuration: --prefix=/home/jim/ffmpeg_build --pkg-config-flags=--static
--extra-cflags=-I/home/jim
/ffmpeg_build/include --extra-ldflags=-L/home/jim/ffmpeg_build/lib
--extra-libs='-lpthread -lm' --bindi
r=/home/jim/bin --disable-ffplay --enable-bzlib --enable-ffmpeg
--enable-gpl --enable-iconv --enable-li
bfdk-aac --enable-libmp3lame --enable-libopus --enable-libsnappy
--enable-libssh --enable-nonfree --ena
ble-openssl --enable-version3 --enable-zlib --enable-libfreetype
--enable-libtwolame --enable-libvpx --
enable-avresample --enable-librsvg --enable-libx264 --enable-libvorbis
--enable-libtheora --enable-libf
reetype --enable-libtwolame --enable-libvpx --enable-avresample
--enable-librsvg --enable-libx264 --ena
ble-libvorbis --enable-libtheora --disable-shared --enable-lto
--enable-static
 libavutil      56. 26.100 / 56. 26.100
 libavcodec     58. 47.103 / 58. 47.103
 libavformat    58. 26.101 / 58. 26.101
 libavdevice    58.  6.101 / 58.  6.101
 libavfilter     7. 48.100 /  7. 48.100
 libavresample   4.  0.  0 /  4.  0.  0
 libswscale      5.  4.100 /  5.  4.100
 libswresample   3.  4.100 /  3.  4.100
 libpostproc    55.  4.100 / 55.  4.100
http://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c92-d3441339c3f2.mp3:
Immediate exit requested


Exiting normally, received signal 2.

jim@jim-Predator-PO9-900:~$ ffmpeg -i
https://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c9
2-d3441339c3f2.mp3
ffmpeg version N-93395-g15d016b Copyright (c) 2000-2019 the FFmpeg
developers
 built with gcc 8 (Ubuntu 8.3.0-3ubuntu1)
 configuration: --prefix=/home/jim/ffmpeg_build --pkg-config-flags=--static
--extra-cflags=-I/home/jim
/ffmpeg_build/include --extra-ldflags=-L/home/jim/ffmpeg_build/lib
--extra-libs='-lpthread -lm' --bindi
r=/home/jim/bin --disable-ffplay --enable-bzlib --enable-ffmpeg
--enable-gpl --enable-iconv --enable-li
bfdk-aac --enable-libmp3lame --enable-libopus --enable-libsnappy
--enable-libssh --enable-nonfree --ena
ble-openssl --enable-version3 --enable-zlib --enable-libfreetype
--enable-libtwolame --enable-libvpx --
enable-avresample --enable-librsvg --enable-libx264 --enable-libvorbis
--enable-libtheora --enable-libf
reetype --enable-libtwolame --enable-libvpx --enable-avresample
--enable-librsvg --enable-libx264 --ena
ble-libvorbis --enable-libtheora --disable-shared --enable-lto
--enable-static
 libavutil      56. 26.100 / 56. 26.100
 libavcodec     58. 47.103 / 58. 47.103
 libavformat    58. 26.101 / 58. 26.101
 libavdevice    58.  6.101 / 58.  6.101
 libavfilter     7. 48.100 /  7. 48.100
 libavresample   4.  0.  0 /  4.  0.  0
 libswscale      5.  4.100 /  5.  4.100
 libswresample   3.  4.100 /  3.  4.100
 libpostproc    55.  4.100 / 55.  4.100
Input #0, mp3, from '
https://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c92-d3441339c3f2.mp
3':
 Metadata:
   encoder         : Lavf58.18.101
 Duration: 00:00:07.81, start: 0.025057, bitrate: 128 kb/s
   Stream #0:0: Audio: mp3, 44100 Hz, stereo, fltp, 128 kb/s
   Metadata:
     encoder         : Lavc58.30
At least one output file must be specified
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

Carl Eugen Hoyos-2
2019-03-19 10:28 GMT+01:00, James Northrup <[hidden email]>:

> I have been having to wrap http in -i <( curl URL) using head ffmpeg on
> ubuntu 19
>
> i want to know if there is a configure switch i might've used that creates
> a situation where http is buggered.  i have two such ubuntu 19 machines
> with similar results.
>
> jim@jim-Predator-PO9-900:~$ lsb_release -a
> No LSB modules are available.
> Distributor ID: Ubuntu
> Description:    Ubuntu Disco Dingo (development branch)
> Release:        19.04
> Codename:       disco
>
> jim@jim-Predator-PO9-900:~$ ffmpeg -i
> http://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c92
> -d3441339c3f2.mp3

This works fine here with current FFmpeg git head, so I assume
the issue is specific to your system / new Ubuntu.

Carl Eugen
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

James Northrup
the addition of a bash curl pipe seems to instigate

[mp3 @ 0x55d81a07c280] Thread message queue blocking; consider raising the
thread_queue_size option (current value: 8)

that i don't see when http:// is a valid working protocol.  the slowdown
adds a lot of wall-clock time.

as of today  i have one ubuntu 19.04 that does fetch http: and one that
does not.  both same buiilds.

On Tue, Mar 19, 2019 at 4:35 PM Carl Eugen Hoyos <[hidden email]> wrote:

> 2019-03-19 10:28 GMT+01:00, James Northrup <[hidden email]>:
> > I have been having to wrap http in -i <( curl URL) using head ffmpeg on
> > ubuntu 19
> >
> > i want to know if there is a configure switch i might've used that
> creates
> > a situation where http is buggered.  i have two such ubuntu 19 machines
> > with similar results.
> >
> > jim@jim-Predator-PO9-900:~$ lsb_release -a
> > No LSB modules are available.
> > Distributor ID: Ubuntu
> > Description:    Ubuntu Disco Dingo (development branch)
> > Release:        19.04
> > Codename:       disco
> >
> > jim@jim-Predator-PO9-900:~$ ffmpeg -i
> > http://prime.kbr.id/storage/audio/2018/10/713b8ade-5172-4fa0-8c92
> > -d3441339c3f2.mp3
>
> This works fine here with current FFmpeg git head, so I assume
> the issue is specific to your system / new Ubuntu.
>
> Carl Eugen
> _______________________________________________
> ffmpeg-user mailing list
> [hidden email]
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> [hidden email] with subject "unsubscribe".
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

Moritz Barsnick
In reply to this post by James Northrup
On Tue, Mar 19, 2019 at 16:28:48 +0700, James Northrup wrote:
> I have been having to wrap http in -i <( curl URL) using head ffmpeg on
> ubuntu 19

Interesting.

> i want to know if there is a configure switch i might've used that creates
> a situation where http is buggered.  i have two such ubuntu 19 machines
> with similar results.

This is your own built binary? You could try a binary from
https://johnvansickle.com/ffmpeg/ for comparison.

It can't be an ffmpeg issue, https uses mostly the same code as http,
except for establishing the connection.

> Immediate exit requested

I don't know which code causes this, perhaps there's more insight from
"-loglevel debug".

Since you write that curl works, I would guess that a semi-transparent
proxy is choking on ffmpeg's implementation of the protocol, but not
curl's? Or the server's HTTP port doesn't like your source address. Or
something similarly stupid. A tcpdump/Wireshark trace might be
interesting. But try a different binary first please.

Cheers,
Moritz
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

James Northrup
> Immediate exit requested

hi Moritz

this was me hitting ctrl-c

it is not impossible that the corporate network is acting with prejudice.
 I didnt see similar bugs by googling so i asked here.  if there's no
obvious build switches to reference then I am OK sticking with curl for
now, or wget -c ahead of time.    bash pipes aren't currently a project
risk, but if this were AWS lambda or google's function hosting ffmpeg the
builtin protocol becomes a lot more serious.

On Tue, Mar 19, 2019 at 8:01 PM Moritz Barsnick <[hidden email]> wrote:

> On Tue, Mar 19, 2019 at 16:28:48 +0700, James Northrup wrote:
> > I have been having to wrap http in -i <( curl URL) using head ffmpeg on
> > ubuntu 19
>
> Interesting.
>
> > i want to know if there is a configure switch i might've used that
> creates
> > a situation where http is buggered.  i have two such ubuntu 19 machines
> > with similar results.
>
> This is your own built binary? You could try a binary from
> https://johnvansickle.com/ffmpeg/ for comparison.
>
> It can't be an ffmpeg issue, https uses mostly the same code as http,
> except for establishing the connection.
>
> > Immediate exit requested
>
> I don't know which code causes this, perhaps there's more insight from
> "-loglevel debug".
>
> Since you write that curl works, I would guess that a semi-transparent
> proxy is choking on ffmpeg's implementation of the protocol, but not
> curl's? Or the server's HTTP port doesn't like your source address. Or
> something similarly stupid. A tcpdump/Wireshark trace might be
> interesting. But try a different binary first please.
>
> Cheers,
> Moritz
> _______________________________________________
> ffmpeg-user mailing list
> [hidden email]
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> [hidden email] with subject "unsubscribe".
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

James Northrup
In reply to this post by Moritz Barsnick
returning to this topic...

downgrading my host environment to ubuntu 18.04 yeilds failures of at least
librsvg and librtmp, the latter of which is documented as an option to
 replace the simpler builtin rtmp.

"pkg-config does not find XXXX" is cropping up on many ubuntu -dev packages

the results appear the same or nearly same in ubuntu 18 and 19 LTS

this started out as an embillished version of # build ffmpeg with
libfdk_aac#
*@ *
https://stackoverflow.com/questions/18746359/compile-ffmpeg-with-libfdk-aac

this gave me good results with a 12Mb  ffmpeg executable for aac he-v2 by
eliminating video codecs

now i'd like to support dash, and live streaming.  maybe host icons from
podcasts as video down the road.  presently, I *think* i need to validate
"ffmpeg  -i rtmp:foo" to mux into dash or HLS

pkgconfig failures from stock ubuntu as follows:
----

sudo apt-get update -qq &&
PKGS=(
    autoconf
    automake
    build-essential
    cmake
    curl
    git
    gpac
    libass-dev
    libbz2-dev
    libfdk-aac-dev
    libfreetype6-dev
    libmp3lame-dev
    libopus-dev
    libsmbclient-dev
    libsnappy-dev
    lib{ss{l,h},r{tmp,svg2}}-dev
    libtool
    libva-dev
    libvorbis-dev
    libvpx-dev
    libxcb1-dev
    libtheora-dev libtwolame-dev libx264-dev libx265-dev
    nasm
    pkg-config
    texinfo
    wget
    yasm
    zlib1g-dev
) && sudo apt-get -y install ${PKGS[@]}
  sudo mkdir -p /usr/local/src;sudo chmod 777 /usr/local/src;pushd
/usr/local/src;

curl https://ffmpeg.org/releases/ffmpeg-snapshot.tar.bz2|tar xjvf - && cd
ffmpeg
let NCPU="1 + $(egrep -e 'processor\s+\:' /proc/cpuinfo|tail -n1|cut -f 2
-d ' ') "


CONFIGS=(
    --disable-ffplay
    --enable-bzlib
    --enable-ffmpeg
    --enable-gpl
    --enable-iconv
    --enable-libfdk-aac
    --enable-libmp3lame
    --enable-libopus
    --enable-libsnappy
    --enable-libssh
    --enable-nonfree
    --enable-openssl
    --enable-version3
    --enable-zlib
)


CONFIGS+=(  #stuff that may not apply to all my servers goes here.

    --enable-libfreetype
    --enable-libtwolame
    --enable-libvpx
#    --enable-cuda-nvcc
    --enable-avresample
    --enable-librsvg
    --enable-librtmp
    --enable-libx264
#    --enable-libx{avs{,2},264}
#    --enable-libx{avs{,2},26{4..5}} avs and x265 -- pkconfig disagrees
    --enable-libvorbis
#    --enable-libdrm
#    --enable-librtmp
    --enable-libtheora
#    --enable-libopenh264
    --enable-gpl
)

TRIMMED=( #likewise, final link decisions may differ
   ${CONFIGS[@]}
    --disable-shared
       --enable-{lto,static}
)
PATH="$HOME/bin:$PATH" PKG_CONFIG_PATH="$HOME/ffmpeg_build/lib/pkgconfig"
./configure \
    --prefix="$HOME/ffmpeg_build" \
    --pkg-config-flags="--static" \
    --extra-cflags="-I$HOME/ffmpeg_build/include" \
    --extra-ldflags="-L$HOME/ffmpeg_build/lib" \
    --extra-libs="-lpthread -lm" \
    --bindir="$HOME/bin" \
    $(eval  echo "${TRIMMED[@]}" ) && \
    make  clean && \
  PATH="$HOME/bin:$PATH" make -j $NCPU && \
  make install && \
  hash -r




On Tue, Mar 19, 2019 at 9:01 PM Moritz Barsnick <[hidden email]> wrote:

> On Tue, Mar 19, 2019 at 16:28:48 +0700, James Northrup wrote:
> > I have been having to wrap http in -i <( curl URL) using head ffmpeg on
> > ubuntu 19
>
> Interesting.
>
> > i want to know if there is a configure switch i might've used that
> creates
> > a situation where http is buggered.  i have two such ubuntu 19 machines
> > with similar results.
>
> This is your own built binary? You could try a binary from
> https://johnvansickle.com/ffmpeg/ for comparison.
>
> It can't be an ffmpeg issue, https uses mostly the same code as http,
> except for establishing the connection.
>
> > Immediate exit requested
>
> I don't know which code causes this, perhaps there's more insight from
> "-loglevel debug".
>
> Since you write that curl works, I would guess that a semi-transparent
> proxy is choking on ffmpeg's implementation of the protocol, but not
> curl's? Or the server's HTTP port doesn't like your source address. Or
> something similarly stupid. A tcpdump/Wireshark trace might be
> interesting. But try a different binary first please.
>
> Cheers,
> Moritz
> _______________________________________________
> ffmpeg-user mailing list
> [hidden email]
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> [hidden email] with subject "unsubscribe".
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".
Reply | Threaded
Open this post in threaded view
|

Re: http hangs, https not, following ubuntu build from scratch.

James Northrup
finally noticed this after i hit send.   "--pkg-config-flags="--static""

this got me past configure.




On Wed, Mar 20, 2019 at 5:17 PM James Northrup <[hidden email]> wrote:

> returning to this topic...
>
> downgrading my host environment to ubuntu 18.04 yeilds failures of at
> least librsvg and librtmp, the latter of which is documented as an option
> to   replace the simpler builtin rtmp.
>
> "pkg-config does not find XXXX" is cropping up on many ubuntu -dev packages
>
> the results appear the same or nearly same in ubuntu 18 and 19 LTS
>
> this started out as an embillished version of # build ffmpeg with
> libfdk_aac#
> *@ *
> https://stackoverflow.com/questions/18746359/compile-ffmpeg-with-libfdk-aac
>
> this gave me good results with a 12Mb  ffmpeg executable for aac he-v2 by
> eliminating video codecs
>
> now i'd like to support dash, and live streaming.  maybe host icons from
> podcasts as video down the road.  presently, I *think* i need to validate
> "ffmpeg  -i rtmp:foo" to mux into dash or HLS
>
> pkgconfig failures from stock ubuntu as follows:
> ----
>
> sudo apt-get update -qq &&
> PKGS=(
>     autoconf
>     automake
>     build-essential
>     cmake
>     curl
>     git
>     gpac
>     libass-dev
>     libbz2-dev
>     libfdk-aac-dev
>     libfreetype6-dev
>     libmp3lame-dev
>     libopus-dev
>     libsmbclient-dev
>     libsnappy-dev
>     lib{ss{l,h},r{tmp,svg2}}-dev
>     libtool
>     libva-dev
>     libvorbis-dev
>     libvpx-dev
>     libxcb1-dev
>     libtheora-dev libtwolame-dev libx264-dev libx265-dev
>     nasm
>     pkg-config
>     texinfo
>     wget
>     yasm
>     zlib1g-dev
> ) && sudo apt-get -y install ${PKGS[@]}
>   sudo mkdir -p /usr/local/src;sudo chmod 777 /usr/local/src;pushd
> /usr/local/src;
>
> curl https://ffmpeg.org/releases/ffmpeg-snapshot.tar.bz2|tar xjvf - && cd
> ffmpeg
> let NCPU="1 + $(egrep -e 'processor\s+\:' /proc/cpuinfo|tail -n1|cut -f 2
> -d ' ') "
>
>
> CONFIGS=(
>     --disable-ffplay
>     --enable-bzlib
>     --enable-ffmpeg
>     --enable-gpl
>     --enable-iconv
>     --enable-libfdk-aac
>     --enable-libmp3lame
>     --enable-libopus
>     --enable-libsnappy
>     --enable-libssh
>     --enable-nonfree
>     --enable-openssl
>     --enable-version3
>     --enable-zlib
> )
>
>
> CONFIGS+=(  #stuff that may not apply to all my servers goes here.
>
>     --enable-libfreetype
>     --enable-libtwolame
>     --enable-libvpx
> #    --enable-cuda-nvcc
>     --enable-avresample
>     --enable-librsvg
>     --enable-librtmp
>     --enable-libx264
> #    --enable-libx{avs{,2},264}
> #    --enable-libx{avs{,2},26{4..5}} avs and x265 -- pkconfig disagrees
>     --enable-libvorbis
> #    --enable-libdrm
> #    --enable-librtmp
>     --enable-libtheora
> #    --enable-libopenh264
>     --enable-gpl
> )
>
> TRIMMED=( #likewise, final link decisions may differ
>    ${CONFIGS[@]}
>     --disable-shared
>        --enable-{lto,static}
> )
> PATH="$HOME/bin:$PATH" PKG_CONFIG_PATH="$HOME/ffmpeg_build/lib/pkgconfig"
> ./configure \
>     --prefix="$HOME/ffmpeg_build" \
>     --pkg-config-flags="--static" \
>     --extra-cflags="-I$HOME/ffmpeg_build/include" \
>     --extra-ldflags="-L$HOME/ffmpeg_build/lib" \
>     --extra-libs="-lpthread -lm" \
>     --bindir="$HOME/bin" \
>     $(eval  echo "${TRIMMED[@]}" ) && \
>     make  clean && \
>   PATH="$HOME/bin:$PATH" make -j $NCPU && \
>   make install && \
>   hash -r
>
>
>
>
> On Tue, Mar 19, 2019 at 9:01 PM Moritz Barsnick <[hidden email]> wrote:
>
>> On Tue, Mar 19, 2019 at 16:28:48 +0700, James Northrup wrote:
>> > I have been having to wrap http in -i <( curl URL) using head ffmpeg on
>> > ubuntu 19
>>
>> Interesting.
>>
>> > i want to know if there is a configure switch i might've used that
>> creates
>> > a situation where http is buggered.  i have two such ubuntu 19 machines
>> > with similar results.
>>
>> This is your own built binary? You could try a binary from
>> https://johnvansickle.com/ffmpeg/ for comparison.
>>
>> It can't be an ffmpeg issue, https uses mostly the same code as http,
>> except for establishing the connection.
>>
>> > Immediate exit requested
>>
>> I don't know which code causes this, perhaps there's more insight from
>> "-loglevel debug".
>>
>> Since you write that curl works, I would guess that a semi-transparent
>> proxy is choking on ffmpeg's implementation of the protocol, but not
>> curl's? Or the server's HTTP port doesn't like your source address. Or
>> something similarly stupid. A tcpdump/Wireshark trace might be
>> interesting. But try a different binary first please.
>>
>> Cheers,
>> Moritz
>> _______________________________________________
>> ffmpeg-user mailing list
>> [hidden email]
>> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>>
>> To unsubscribe, visit link above, or email
>> [hidden email] with subject "unsubscribe".
>
>
_______________________________________________
ffmpeg-user mailing list
[hidden email]
https://ffmpeg.org/mailman/listinfo/ffmpeg-user

To unsubscribe, visit link above, or email
[hidden email] with subject "unsubscribe".