Hi all, I'm trying to enhance an android app with video chat capabilities, so I dove into the pjsip configuration/building nightmare for an entire weekend... (no offense to the devs on this project, but I don't think I've ever had such a difficult experience building software). After lots of fails and retries, I managed to get pjsip built with openh264 and openssl support. For testing purposes, I'm using two devices - an android phone and an android tablet. Both are running pjsua2. I created two sip accounts with iptel (which I'm using as the accounts for pjsua2). I'm pretty psyched that I'm able to make voice calls between the two android devices. However, video doesn't seem to be happening yet. I don't want to spam the list with my Android Monitor logcat output, so I've placed it on my web server here: http://prowlers.com/~cdavis/logcat-output.txt The lines that seem to spell out a problem are: 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: java.lang.Exception: Title: pjsua_vid_dev_set_setting(dev_id, PJMEDIA_VID_DEV_CAP_ORIENTATION, &orient, keep) 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: Code: 520008 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: Description: Invalid or unsupported video capability (PJMEDIA_EVID_INVCAP) 09-10 18:45:25.163 18504-18504/org.pjsip.pjsua2.app I/System.out: Location: ../src/pjsua2/media.cpp:1510 09-10 18:45:25.292 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.290 openh264.cpp Unpacketize error: Ignored (PJ_EIGNORED) 09-10 18:45:25.294 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.293 vstdec0x75c6b7 codec decode() error: Ignored (PJ_EIGNORED) [err:70020] 09-10 18:45:25.395 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.394 openh264.cpp Unpacketize error: Ignored (PJ_EIGNORED) 09-10 18:45:25.397 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.396 vstdec0x75c6b7 codec decode() error: Ignored (PJ_EIGNORED) [err:70020] 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.868 pjsua_core.c .TX 672 bytes Request msg INFO/cseq=25195 (tdta0x75aab23000) to UDP 212.79.111.155:5060: 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: INFO sip:1E50FE26-59B5EAB0000A12B4-79CD7700@212.79.111.155;transport=udp SIP/2.0 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: Via: SIP/2.0/UDP 174.71.214.73:6000;rport;branch=z9hG4bKPj9a79e580-a5b5-496c-8706-36078f378710 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Max-Forwards: 70 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: From: <sip:calebadavis@iptel.org>;tag=8d16111c-db8b-44e7-8c56-f6ee7367ac9d 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: To: "James Kirk" <sip:jtkirk@prowlers.onsip.com>;tag=1E50FE26-59B5EAB0000A12B4-79CD7700 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Call-ID: 34869A09-59B5EAB0000A12C1-79CD7700 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: CSeq: 25195 INFO 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: User-Agent: Pjsua2 Android 2.6 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Content-Type: application/media_control+xml 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Content-Length: 146 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: <?xml version="1.0" encoding="utf-8" ?><media_control><vc_primitive><to_encoder><picture_fast_update/></to_encoder></vc_primitive></media_control> 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: --end msg-- Thinking it was an issue with the video codec, I spent several hours trying to use the android ndk cross compiler to build various versions of ffmpeg for android, and finally succeeded with 2.8.1, but the pjsip configure script never seemed to take the prefix I supplied (--with-ffmpeg=), so I gave up and rebuilt with only h264. I also tried using my internal wifi (with and without SIP ALG enabled on my router) as well as just my cell carrier (Verizon) for network connectivity. Please, if anyone could point me in the right direction, I'd be extremely grateful. -Caleb

Hi, From you log, it seems there is no cap_dev. Did you asked for permission to use the camera ? The following is logged even before you try to set the orientation : 09-10 20:51:31.113 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.112 pjsua_vid.c ......Video channel update.. 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.121 vstenc0x75abde .......Encoder stream started 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.122 vstdec0x75abde .......Decoder stream started 09-10 20:51:31.123 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.123 pjsua_vid.c .......Setting up RX.. 09-10 20:51:31.124 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 pjsua_vid.c ........Creating video window: type=stream, cap_id=-1, rend_id=0 09-10 20:51:31.125 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 vid_port.c .........Opening device OpenGL renderer [OpenGL] for render: format=I420, size=656x656 @22:1 fps 09-10 20:51:31.126 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.125 android_opengl .........Re-initializing OpenGL due to format change 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.126 android_opengl .........Android OpenGL ES renderer successfully created 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.127 vid_port.c .........Device OpenGL renderer [OpenGL] opened: format=I420, size=656x656 @22:1 fps 09-10 20:51:31.128 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.128 pjsua_vid.c .........stream window id 0 created for cap_dev=-1 rend_dev=0 Best Regards. > On 11 Sep 2017, at 7:07, James T. Kirk <jtkirk@prowlers.com> wrote: > > Hi all, > > I'm trying to enhance an android app with video chat capabilities, so I dove into the pjsip configuration/building nightmare for an entire weekend... (no offense to the devs on this project, but I don't think I've ever had such a difficult experience building software). > After lots of fails and retries, I managed to get pjsip built with openh264 and openssl support. > > For testing purposes, I'm using two devices - an android phone and an android tablet. Both are running pjsua2. I created two sip accounts with iptel (which I'm using as the accounts for pjsua2). I'm pretty psyched that I'm able to make voice calls between the two android devices. However, video doesn't seem to be happening yet. > I don't want to spam the list with my Android Monitor logcat output, so I've placed it on my web server here: > http://prowlers.com/~cdavis/logcat-output.txt <http://prowlers.com/~cdavis/logcat-output.txt> > The lines that seem to spell out a problem are: > > 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: java.lang.Exception: Title: pjsua_vid_dev_set_setting(dev_id, PJMEDIA_VID_DEV_CAP_ORIENTATION, &orient, keep) > 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: Code: 520008 > 09-10 18:45:25.162 18504-18504/org.pjsip.pjsua2.app I/System.out: Description: Invalid or unsupported video capability (PJMEDIA_EVID_INVCAP) > 09-10 18:45:25.163 18504-18504/org.pjsip.pjsua2.app I/System.out: Location: ../src/pjsua2/media.cpp:1510 > 09-10 18:45:25.292 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.290 openh264.cpp Unpacketize error: Ignored (PJ_EIGNORED) > 09-10 18:45:25.294 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.293 vstdec0x75c6b7 codec decode() error: Ignored (PJ_EIGNORED) [err:70020] > 09-10 18:45:25.395 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.394 openh264.cpp Unpacketize error: Ignored (PJ_EIGNORED) > 09-10 18:45:25.397 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.396 vstdec0x75c6b7 codec decode() error: Ignored (PJ_EIGNORED) [err:70020] > 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: 18:45:25.868 pjsua_core.c .TX 672 bytes Request msg INFO/cseq=25195 (tdta0x75aab23000) to UDP 212.79.111.155:5060: > 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: INFO sip:1E50FE26-59B5EAB0000A12B4-79CD7700@212.79.111.155;transport=udp <mailto:sip:1E50FE26-59B5EAB0000A12B4-79CD7700@212.79.111.155;transport=udp> SIP/2.0 > 09-10 18:45:25.870 18504-18676/org.pjsip.pjsua2.app I/System.out: Via: SIP/2.0/UDP 174.71.214.73:6000;rport;branch=z9hG4bKPj9a79e580-a5b5-496c-8706-36078f378710 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Max-Forwards: 70 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: From: <sip:calebadavis@iptel.org> <mailto:sip:calebadavis@iptel.org>;tag=8d16111c-db8b-44e7-8c56-f6ee7367ac9d > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: To: "James Kirk" <sip:jtkirk@prowlers.onsip.com> <mailto:sip:jtkirk@prowlers.onsip.com>;tag=1E50FE26-59B5EAB0000A12B4-79CD7700 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Call-ID: 34869A09-59B5EAB0000A12C1-79CD7700 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: CSeq: 25195 INFO > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: User-Agent: Pjsua2 Android 2.6 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Content-Type: application/media_control+xml > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: Content-Length: 146 > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: <?xml version="1.0" encoding="utf-8" ?><media_control><vc_primitive><to_encoder><picture_fast_update/></to_encoder></vc_primitive></media_control> > 09-10 18:45:25.871 18504-18676/org.pjsip.pjsua2.app I/System.out: --end msg-- > > > Thinking it was an issue with the video codec, I spent several hours trying to use the android ndk cross compiler to build various versions of ffmpeg for android, and finally succeeded with 2.8.1, but the pjsip configure script never seemed to take the prefix I supplied (--with-ffmpeg=), so I gave up and rebuilt with only h264. > > I also tried using my internal wifi (with and without SIP ALG enabled on my router) as well as just my cell carrier (Verizon) for network connectivity. > Please, if anyone could point me in the right direction, I'd be extremely grateful. > > -Caleb > > _______________________________________________ > Visit our blog: http://blog.pjsip.org > > pjsip mailing list > pjsip@lists.pjsip.org > http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org

Hi Oren, thank you for the quick reply. Yes, since I'm developing an Android 6.0+ app, I tried (in MainActivity.onCreate()): ActivityCompat.requestPermissions(this,new String[]{ Manifest.permission.RECORD_AUDIO, Manifest.permission.CAMERA },1); I think my issue might be related to a wrong version of the h264 library - I'm rebuilding the world right now and making sure that I didn't copy binaries for the wrong architecture (armeabi vs arm64-v8a). I did a lot of flailing around in my initial build attempts, building multiple times with a lot of different flags and defines, and I definitely had multiple versions of shared object libraries in play. -Caleb On 9/11/17 10:19 AM, Oren Barash wrote: > Hi, > > From you log, it seems there is no cap_dev. > Did you  asked for permission to use the camera ? > > The following is logged even before you try to set the orientation : > 09-10 20:51:31.113 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.112 pjsua_vid.c ......Video channel update.. > 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.121 vstenc0x75abde .......Encoder stream started > 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.122 vstdec0x75abde .......Decoder stream started > 09-10 20:51:31.123 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.123 pjsua_vid.c .......Setting up RX.. > 09-10 20:51:31.124 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 pjsua_vid.c ........Creating video window: type=stream, cap_id=-1, rend_id=0 > 09-10 20:51:31.125 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 vid_port.c .........Opening device OpenGL renderer [OpenGL] for render: format=I420, size=656x656 @22:1 fps > 09-10 20:51:31.126 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.125 android_opengl .........Re-initializing OpenGL due to format change > 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.126 android_opengl .........Android OpenGL ES renderer successfully created > 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.127 vid_port.c .........Device OpenGL renderer [OpenGL] opened: format=I420, size=656x656 @22:1 fps > 09-10 20:51:31.128 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.128 pjsua_vid.c .........stream window id 0 created for*cap_dev=-1* rend_dev=0 > > > Best Regards. > >

Hi Caleb, I attached my build script. I hope it will help you (any maybe someone else on this mailing list). I use it on my project, so I can guarantee it is working :-) Hope it helps, Oren > On 12 Sep 2017, at 0:50, James T. Kirk <jtkirk@prowlers.com> wrote: > > Hi Oren, thank you for the quick reply. Yes, since I'm developing an Android 6.0+ app, I tried (in MainActivity.onCreate()): > > ActivityCompat.requestPermissions(this, new String[]{ > Manifest.permission.RECORD_AUDIO, > Manifest.permission.CAMERA > }, 1); > I think my issue might be related to a wrong version of the h264 library - I'm rebuilding the world right now and making sure that I didn't copy binaries for the wrong architecture (armeabi vs arm64-v8a). I did a lot of flailing around in my initial build attempts, building multiple times with a lot of different flags and defines, and I definitely had multiple versions of shared object libraries in play. > > -Caleb > > On 9/11/17 10:19 AM, Oren Barash wrote: >> Hi, >> >> From you log, it seems there is no cap_dev. >> Did you asked for permission to use the camera ? >> >> The following is logged even before you try to set the orientation : >> 09-10 20:51:31.113 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.112 pjsua_vid.c ......Video channel update.. >> 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.121 vstenc0x75abde .......Encoder stream started >> 09-10 20:51:31.122 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.122 vstdec0x75abde .......Decoder stream started >> 09-10 20:51:31.123 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.123 pjsua_vid.c .......Setting up RX.. >> 09-10 20:51:31.124 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 pjsua_vid.c ........Creating video window: type=stream, cap_id=-1, rend_id=0 >> 09-10 20:51:31.125 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.124 vid_port.c .........Opening device OpenGL renderer [OpenGL] for render: format=I420, size=656x656 @22:1 fps >> 09-10 20:51:31.126 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.125 android_opengl .........Re-initializing OpenGL due to format change >> 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.126 android_opengl .........Android OpenGL ES renderer successfully created >> 09-10 20:51:31.127 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.127 vid_port.c .........Device OpenGL renderer [OpenGL] opened: format=I420, size=656x656 @22:1 fps >> 09-10 20:51:31.128 8087-8134/org.pjsip.pjsua2.app I/System.out: 20:51:31.128 pjsua_vid.c .........stream window id 0 created for cap_dev=-1 rend_dev=0 >> >> >> Best Regards. >> >> > > _______________________________________________ > Visit our blog: http://blog.pjsip.org > > pjsip mailing list > pjsip@lists.pjsip.org > http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org