Blocking performance issue with videos / animations

General Discussion
#1

We have started the development of our App under the Windows environment, before switching to Linux.

We have a blocking performance issue with videos / animations.
We are using an Atom-based system (dual core 1.5Ghz + Intel HD Graphics + 2Gig of RAM + S-ATA 6 SSD Drive + Win10).
All minimal specs for ProMM are fulfilled (e.g. OpenGL 4.0).
The system iteself is very responsive. If we play a Full HD video through the Windows native player, it will take 5%-10% of CPU, and the overall CPU usage will be around 10-15% max.

When trying « just » to play the same Full HD video through ProMM, we simply can’t get all frames, and the CPU usages climbs to 99%.
We will get something like the 5 to 10 first frames, then the video will hang, and sometimes we’ll get some additional 5 frames.
The video is inserted onto a blank page, menus, controls, and everything else is de-activated.
If trying (as another example) to play the Travel template (through the Player, not through Designer), the TimeLapses are showing the same problems: jerky at best, only some frames in most cases.
As per the

Any help?

#2

By default Qt uses the DirectShow for video playback. We use the Windows Media Foundation for better compatibility when exporting projects. The DirectShow requires codecs.

To try the DirectShow, replace the following files:

  • Qt5Multimedia.dll
  • Qt5MultimediaQuick_p.dll
  • mediaservice (folder)
  • QtMultimedia (folder)
#3

Thanks for this … but not working.
This is what I tested:

  • copied the files to the Resources folder from a given test App > the App crashes or does not display video
  • copies the files to the Designer folder > when inserting a video, it will not play (pushing the play icon will do nothing, it will briefly turn to pause icon, that’s all, but the video or audio will not play, whatever the format)

Any clue (the system is running Win10 64bit Home Edition)?

#4

You need to replace the files in the Designer folder. Download modified version here
The video has not played because there is no codecs. Try to play centaur_1.avi video. This is the MPEG 1 format that does not require any codecs.
What example are you using with zero cpu? And what version of the Qt?

#5

Replacing files in the Designer folder is what I did.
I also used your .zip, just in case.
But exactly the same result.

I’m a little bit confused by the codec aspect.
The test videos we are using are 1080p h264 .mov « home-made » videos.
Such videos are played « natively » by Win10, so codecs seems to be already installed.
If we play them through Windows Media Player (which is a 32bits app), CPU will raise from 5% to 20% (for Windows Media Player itself) then go back to a stable 5-10%.
If we play them through the new « Windows Movies », same.
If we play them through Designer (before .dll mods), CPU will raise to 85% for Designer, and 99% for the whole system. So CPU is a bottleneck there.
Now if we try some MPEG1 file, Designer DirectShow will play it but raise CPU to 45%-55%. This is huge.
There is something we don’t get…

About Qt, we just tried http://doc.qt.io/qt-5/videooverview.html
I can have a check on this later on (I did not run the test myself).

Any progress on the Linux port?

#6

Could you please send me the linux console output with errors and messages.

#7

Ubuntu 16.04 TLS:

Memory lock already exists, but owner process isn’t running. Taking ownership on this lock…
qt.network.ssl: QSslSocket: cannot resolve SSLv2_client_method
qt.network.ssl: QSslSocket: cannot resolve SSLv2_server_method
[0106/134909:ERROR:browser_main_loop.cc(217)] Running without the SUID sandbox! See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_suid_sandbox_development.md for more information on developing with the sandbox on.
Qt WebEngine ICU data not found at /home/work/Qt5.7.0/5.7/gcc_64/resources. Trying parent directory…
Qt WebEngine ICU data not found at /home/work/Qt5.7.0/5.7/gcc_64. Trying application directory…
Installed Qt WebEngine locales directory not found at location /home/work/Qt5.7.0/5.7/gcc_64/translations/qtwebengine_locales. Trying application directory…
Qt WebEngine resources not found at /home/work/Qt5.7.0/5.7/gcc_64/resources. Trying parent directory…
Qt WebEngine resources not found at /home/work/Qt5.7.0/5.7/gcc_64. Trying application directory…
Xlib: sequence lost (0x172ab > 0x72ac) in reply type 0x23!

The PMA consists in:

  • blank « New Page » from the blank template
  • addition of one local video (1080p H264 Mov) reduced to 50%
  • addition of a 1080p Youtube video reduced to 50%
  • controls to play each video

What’s happening:

  • we just see the first image of the local video (can’t play)
  • the Youtube video takes a while to load and is jerky
  • no top bar
  • no bottom bar
  • no navigation bar
  • no exit button

It’s always the same 1080p local video (the same used for tests on Win10).
Codecs have been installed on Ubuntu to play it.

Back on Windows, we have spent hours to try to get ProMM play videos correctly.
On the regular app, no luck to get the videos smooth.
On the DirectShow version, nothing is played, although we installed additional codecs (e.g. ffdshow) to be certain there is no codec problem.
We even transcoded videos to be H264 but with MP4 high level format, and used various quality profiles to make the files « lighter ».
But still no luck: not played or jerky.
I don’t know what’s happening there, but if we don’t have a solution rapidly (being under Linux or Win10), we are going to move to direct coding (or another authoring solution).

Back to Flipabit >
Copyright © 2018. Flipabit Team. All rights reserved.