Configuring the BigBlueButton recording transfer #147

mohamedelashhab · 2020-04-11T17:19:02Z

I installed scalelite and i have 4 polls , every thing work fine and all polls online and connected but the published records not tranfered to main server scalelite i have a trouble with transfer configuration please help

agustinmono · 2020-04-11T19:14:31Z

*** Not Solved ***

This is what I done, no luck making it work, but maybe you can try
https://vitux.com/install-nfs-server-and-client-on-ubuntu/

Server NFS Side - Scalelite:

sudo apt install nfs-kernel-server
sudo mkdir -p /mnt/scalelite-recordings
sudo chown nobody:nogroup /mnt/scalelite-recordings
sudo chmod 777 /mnt/scalelite-recordings
sudo nano /etc/exports
Inside exports, one line by BBB IP, this is the most important part, in the documentation says ,
(rw,sync,no_subtree_check), insted you need to:

/mnt/scalelite-recordings Client_IP_BBB(rw,sync,subtree_check)

sudo exportfs -a

sudo systemctl restart nfs-kernel-server

sudo ufw allow from [clientIP or clientSubnetIP] to any port nfs

Client NFS Silde - BigBlueButton

sudo apt-get update
sudo apt-get install nfs-common
sudo mkdir -p /mnt/scalelite-recordings
sudo mount serverIP:/mnt/scalelite-recordings /mnt/scalelite-recordings

Jumped to : https://github.com/blindsidenetworks/scalelite/blob/master/sharedvolume-README.md

agustinmono · 2020-04-11T19:18:55Z

This erros show upo when i run the script

sudo sh scalelite_batch_import.sh

root@bbb-01:/# sudo sh scalelite_batch_import.sh
scalelite_batch_import.sh: 15: scalelite_batch_import.sh: [[: not found
/usr/lib/ruby/vendor_ruby/rubygems/defaults/operating_system.rb:10: warning: constant Gem::ConfigMap is deprecated
Transferring recording for 05a733aeda9e727f47f0d7103486ad8151e332d2-1586463351690 to Scalelite
Found recording format: presentation/05a733aeda9e727f47f0d7103486ad8151e332d2-1586463351690
Creating recording archive
Transferring recording archive to /mnt/scalelite-recordings/var/bigbluebutton/spool
05a733aeda9e727f47f0d7103486ad8151e332d2-1586463351690.tar
rsync: mkstemp "/mnt/scalelite-recordings/var/bigbluebutton/spool/.05a733aeda9e727f47f0d7103486ad8151e332d2-1586463351690.tar.JuWehx" failed: Permission denied (13)

agustinmono · 2020-04-11T19:26:40Z

root@bbb-01:~# sudo -n -u bigbluebutton touch /mnt/scalelite-recordings/var/bigbluebutton/spool/222
touch: cannot touch '/mnt/scalelite-recordings/var/bigbluebutton/spool/222': Permission denied

secretreal26 · 2020-04-12T11:59:10Z

You can check :
https://github.com/blindsidenetworks/scalelite/issues/90

agustinmono · 2020-04-12T16:49:49Z

I did it and now it works thanks a lot

just some issue, the records are not showing up in the greenligh front end, how can I check that its working

rabser · 2020-04-12T19:22:34Z

If you are using NFSv4 as scalelite recording spool filesystem, you should verify that the domain information on either NFS server and client are coeherent and you should check that in either NFS server and client there are the SAME users with the SAME userid.
But this is not about scalelite, it's about configuring NFS.

agustinmono · 2020-04-12T20:48:13Z

How can i check that, can you give me a hand there?
Thabks

mohamedelashhab · 2020-04-15T00:22:47Z

i want a help in Transfer using rsync over SSH section @agustinmono
i have done all steps you showed me at the top and works fine but i want your help in the section of Transfer using rsync over SSH

mohamedelashhab · 2020-04-15T01:08:49Z

@agustinmono
i want to Ensure that the bigbluebutton user has permission to enter and write to the spool directory.
sudo chown -R bigbluebutton:bigbluebutton /mnt/scalelite-recordings/var/bigbluebutton/spool
changing ownership of '/mnt/scalelite-recordings/var/bigbluebutton/spool': Operation not permitted

agustinmono · 2020-04-15T03:53:03Z

I dont know really, i just usted the NFS . Didnt use rsync over ssh

mohamedelashhab · 2020-04-15T11:15:23Z

@agustinmono i used nfs like you
could you tell me how old records works ?

mohamedelashhab · 2020-04-15T13:27:39Z

when I run sudo sh scalelite_batch_import.sh
get that Can't open scalelite_post_publish.rb

agustinmono · 2020-04-15T20:19:59Z

first run this commands on the scalelite server (needs to be a different server that bigbluebutton)

# Create the spool directory for recording transfer from BigBlueButton
mkdir -p /mnt/scalelite-recordings/var/bigbluebutton/spool
chown 1000:2000 /mnt/scalelite-recordings/var/bigbluebutton/spool
chmod 0775 /mnt/scalelite-recordings/var/bigbluebutton/spool

# Create the temporary (working) directory for recording import
mkdir -p /mnt/scalelite-recordings/var/bigbluebutton/recording/scalelite
chown 1000:1000 /mnt/scalelite-recordings/var/bigbluebutton/recording/scalelite
chmod 0775 /mnt/scalelite-recordings/var/bigbluebutton/recording/scalelite

# Create the directory for published recordings
mkdir -p /mnt/scalelite-recordings/var/bigbluebutton/published
chown 1000:1000 /mnt/scalelite-recordings/var/bigbluebutton/published
chmod 0775 /mnt/scalelite-recordings/var/bigbluebutton/published

# Create the directory for unpublished recordings
mkdir -p /mnt/scalelite-recordings/var/bigbluebutton/unpublished
chown 1000:1000 /mnt/scalelite-recordings/var/bigbluebutton/unpublished
chmod 0775 /mnt/scalelite-recordings/var/bigbluebutton/unpublished




Then 


do this
https://github.com/blindsidenetworks/scalelite/issues/90

agustinmono · 2020-04-15T20:20:58Z

also you can check my issues
#129
#141

mohamedelashhab · 2020-04-16T01:33:08Z

thank you for your help @agustinmono
after i configured what you mentioned me at the top i got that

scalelite_batch_import.sh: 16: scalelite_batch_import.sh: [[: not found
Transferring recording for 04816973751d104d6b2743bc80b9eaa2e86262d9-1586707448002 to Scalelite
Found recording format: presentation/04816973751d104d6b2743bc80b9eaa2e86262d9-1586707448002
Creating recording archive
Adding extra rsync options:
Transferring recording archive to /mnt/scalelite-recordings/var/bigbluebutton/spool

and nothing happend after i was waiting 1 hour

agustinmono · 2020-04-16T12:51:48Z

can you post the output of

ls /mnt/scalelite-recordings/var/bigbluebutton/spool

mohamedelashhab · 2020-04-16T14:27:33Z

@agustinmono
when i run ls /mnt/scalelite-recordings/var/bigbluebutton/spool on scalelite server give me nothing
empty output

agustinmono · 2020-04-16T14:55:41Z

Try rebooting the server

after that if keeps try unmounting the partition and mount again

mohamedelashhab · 2020-04-21T14:23:20Z

@rabser
@agustinmono
when i run script give me
scalelite_batch_import.sh: 16: scalelite_batch_import.sh: [[: not found
/usr/lib/ruby/vendor_ruby/rubygems/defaults/operating_system.rb:10: warning: constant Gem::ConfigMap is deprecated
Transferring recording for ffd81b599a40efb9306cb1fe2334b7d5f165a8d1-1586680305091 to Scalelite
Found recording format: presentation/ffd81b599a40efb9306cb1fe2334b7d5f165a8d1-1586680305091
Creating recording archive
Adding extra rsync options:
Transferring recording archive to /mnt/scalelite-recordings/var/bigbluebutton/spool
ffd81b599a40efb9306cb1fe2334b7d5f165a8d1-1586680305091.tar
sent 5,633,500 bytes received 35 bytes 11,267,070.00 bytes/sec
total size is 5,632,000 speedup is 1.00

but when i run ls /mnt/scalelite-recordings/var/bigbluebutton/spool
give me nothing

rabser · 2020-04-21T23:59:50Z

The transfer happened, if the scalelite-importer did its job correctly, then the transferred file were deleted from the spool: this it right.
Do you checked if the recording is now available from the cluster url ?

mohamedelashhab · 2020-04-22T08:41:09Z

@rabser
url available but give me record not found after i visited it from moodle
and there is no records in /mnt/scalelite-recordings/var/bigbluebutton/published/presentation after transfering records through scalelite_batch_import.sh

rabser · 2020-04-22T08:46:06Z

At this point i don't know.

mohamedelashhab · 2020-04-22T11:13:37Z

@rabser thank you
there was a permission problem with scalelite-recordings that abort transferring to published
now it works for chmod -R 777

revdsam · 2020-04-24T00:33:02Z

@mohamedelashhab

I experienced this same issue -- if permissions are not correct, the files do not end up published but the importer deletes the recordings and so you end up with nothing after everything is processed. In my case I did not see any errors reported anywhere, only evidence of a problem is recordings vaporized.

farhatahmad · 2020-04-24T14:51:59Z

Looks like everything was solved here. Thanks for your support @rabser @agustinmono

AminaSaif · 2020-05-17T07:29:11Z

@revdsam

I experienced this same issue -- if permissions are not correct, the files do not end up published but the importer deletes the recordings and so you end up with nothing after everything is processed. In my case I did not see any errors reported anywhere, only evidence of a problem is recordings vaporized.

I think we are experiencing the same, we have noticed that some recordings are no longer available on the shared drive. Let say out of 20 records only 16 are available on Scalelite and 4 are missing!! Can you advise on how to troubleshoot and resolve this issue.

german2209 · 2020-06-28T17:09:32Z

@rabser thank you
there was a permission problem with scalelite-recordings that abort transferring to published
now it works for chmod -R 777

Hi,
I'm facing a trouble of permission errors for the recordings transfer.
I have followed and executed every step mentioned above but can't get rid of a Permission denied (13) when executing the scalelite_batch_import.sh
My recordings never gets to the shared NFS.
Can you share with me how did you setup the permissions in the NFS backend and BBB?
Thanks in advance for your help.

rexon07 · 2020-08-07T05:57:38Z

@agustinmono Hi,

i followed the steps by you regarding NFS and also referred https://vitux.com/install-nfs-server-and-client-on-ubuntu/
After running the mount command i get an connection time out error. Can you let me know what might be the issue here.
https://prnt.sc/tvi4hy

rohitcoder · 2020-09-04T15:29:54Z

@agustinmono @rabser @mohamedelashhab i am getting this error while running sh scalelite_batch_import.sh any idea why?

scalelite_batch_import.sh: 15: scalelite_batch_import.sh: [[: not found
/usr/lib/ruby/vendor_ruby/rubygems/defaults/operating_system.rb:10: warning: constant Gem::ConfigMap is deprecated
Transferring recording for fcf236af9747db4374c89529d812c361d807681d-1599159500290 to Scalelite
Found recording format: presentation/fcf236af9747db4374c89529d812c361d807681d-1599159500290
Creating recording archive
Transferring recording archive to /mnt/scalelite-recordings/var/bigbluebutton/spool
fcf236af9747db4374c89529d812c361d807681d-1599159500290.tar

sent 2,581,236 bytes  received 35 bytes  5,162,542.00 bytes/sec
total size is 2,580,480  speedup is 1.00
Adding extra rsync options:   
Transferring recording archive to /mnt/scalelite-recordings/var/bigbluebutton/spool
rsync: link_stat "/var/bigbluebutton/recording/scalelite/fcf236af9747db4374c89529d812c361d807681d-1599159500290.tar" failed: No such file or directory (2)

sent 16 bytes  received 12 bytes  56.00 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
./post_publish/scalelite_post_publish.rb:74:in `<main>': Failed to transfer recording archive (RuntimeError)

andrekutianski · 2020-12-05T01:23:48Z

If you are using NFSv4 as scalelite recording spool filesystem, you should verify that the domain information on either NFS server and client are coeherent and you should check that in either NFS server and client there are the SAME users with the SAME userid.
But this is not about scalelite, it's about configuring NFS.

Is there a recommended configuration for use along with the necessary permissions for scalelite beyond the standard that many are likely to be using?

For example, I use the basic config in /etc/exports

/mnt/scalelite-recordings 10.0.0.100(rw,sync,no_root_squash)

ontimond · 2021-02-18T23:41:30Z

If you are using NFSv4 as scalelite recording spool filesystem, you should verify that the domain information on either NFS server and client are coeherent and you should check that in either NFS server and client there are the SAME users with the SAME userid.
But this is not about scalelite, it's about configuring NFS.

Is there a recommended configuration for use along with the necessary permissions for scalelite beyond the standard that many are likely to be using?

For example, I use the basic config in /etc/exports
/mnt/scalelite-recordings 10.0.0.100(rw,sync,no_root_squash)

This NFS config worked for me
/mnt/scalelite-recordings xxx.xxx.xx.xx(rw,sync,all_squash,anonuid=2000,anongid=2000)

See https://serverfault.com/a/241272/532044

uzeportal · 2021-08-07T19:10:30Z

Hello there. I don't know much about these matters. I only have little knowledge of installing bbb servers and scalelite server. I can setup my own scalelite server and bbb servers. But I don't know anything about records. Please help me with this. I would appreciate it if you could write the installation commands step by step.

I have 24 of my own BBB servers. BBB version 2.3 was installed on each virtual server by dividing it into vps on a physical server. I'm also using Scalelite as a load balancer. Previously, we used to download lecture recordings as mp4 while using individual bbb server. However, when I start using scalelite, the records do not appear on the scalelite server. It appears on BBB servers, but these recordings cannot be viewed on moodle and therefore we cannot download them as mp4. For this reason, I stopped using scalelite for now and started using it by duplicating dozens of bbb plugins on the moodle site as a much more difficult method. I am using a BBB plugin for each BBB live lecture room. In the use of Scalelite, how will the records in each bbb server be listed in moodle, what should I do?
Pls help me.

mohamedelashhab · 2021-08-09T11:16:39Z

Are you tried to follow these comments?

mohamedelashhab · 2021-08-09T11:17:18Z

Are you sure all services works fine?

uzeportal · 2021-08-09T12:48:49Z

I installed Scalelite according to the instructions in this link: https://jffederico.medium.com/scalelite-lazy-deployment-745a7be849f6

I did what is necessary to activate the Scalelite Registration Function according to the instructions in this link: https://jffederico.medium.com/scalelite-lazy-deployment-part-ii-ca3e4bf82f8d

Scalelite works fine. It distributes new live lesson requests to bbb servers according to availability. However, I could not record the lecture videos.

mohamedelashhab · 2021-08-09T13:02:45Z

Did you mean record not transferred to scalelite server but its on own bbb server?

fmasoudy · 2021-08-31T12:26:11Z

@rabser thank you
there was a permission problem with scalelite-recordings that abort transferring to published
now it works for chmod -R 777

This solved my issue

It should be mentioned in https://github.com/blindsidenetworks/scalelite/blob/master/sharedvolume-README.md#setting-up-a-shared-volume-for-recordings

harika1258 · 2021-09-04T12:35:18Z

Hi @fmasoudy

@rabser thank you
there was a permission problem with scalelite-recordings that abort transferring to published
now it works for chmod -R 777

This solved my issue

It should be mentioned in https://github.com/blindsidenetworks/scalelite/blob/master/sharedvolume-README.md#setting-up-a-shared-volume-for-recordings

where we should put this command chmod -R 777 ?

fmasoudy · 2021-09-04T14:21:20Z

I used it on the scalelite-recordings folder and everything went okay for me.

…

On Sat, Sep 4, 2021, 3:35 PM Resoufi ***@***.***> wrote: Hi @fmasoudy <https://github.com/fmasoudy> @rabser <https://github.com/rabser> thank you there was a permission problem with scalelite-recordings that abort transferring to published now it works for chmod -R 777 This solved my issue It should be mentioned in https://github.com/blindsidenetworks/scalelite/blob/master/sharedvolume-README.md#setting-up-a-shared-volume-for-recordings <http://url> where we should put this command chmod -R 777 ? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#147 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEFV233MINJY3UGCNLLZENDUAIHBBANCNFSM4MGCNDMA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

harika1258 · 2021-09-04T18:11:26Z

Thank you so much @fmasoudy
in the each BBB server or ScaleLite?
I do it, but I have no recording in the scalelite-recordings folder!
what is your idea?
And Front-end don't show any recordings. but we have all of recordings in the bbb servers.

fmasoudy · 2021-09-05T10:59:48Z

It should be done once on the mounted volume on scalelite.

…

On Sat, Sep 4, 2021, 9:11 PM Resoufi ***@***.***> wrote: Thank you so much @fmasoudy <https://github.com/fmasoudy> in the each BBB server or ScaleLite? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#147 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEFV23Z3XZ6NUAWMUZITOIDUAJONTANCNFSM4MGCNDMA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

harika1258 · 2021-09-05T11:20:49Z

@fmasoudy
I did it. but already not happened! :-(

khaclamxd · 2024-03-03T03:26:18Z

Dear,
I have configured everything OK, connecting scalelite API and moodle successfully. However, like you, in the RECORDINGS display section of BBB it always shows "No Data display". Please share if anyone has solved the problem.
https://prnt.sc/B6DpaAsrwHvr

https://prnt.sc/h1N20ciq3z9U
Sincerely thank you!

farhatahmad closed this as completed Apr 24, 2020

lightweight mentioned this issue May 11, 2020

Rationalising the UID and GID of bigbluebutton user in Scalelite containers #203

Open

Configuring the BigBlueButton recording transfer #147

Configuring the BigBlueButton recording transfer #147

Comments

mohamedelashhab commented Apr 11, 2020

agustinmono commented Apr 11, 2020 • edited Loading

agustinmono commented Apr 11, 2020

agustinmono commented Apr 11, 2020

secretreal26 commented Apr 12, 2020 • edited Loading

agustinmono commented Apr 12, 2020

rabser commented Apr 12, 2020

agustinmono commented Apr 12, 2020

mohamedelashhab commented Apr 15, 2020

mohamedelashhab commented Apr 15, 2020 • edited Loading

agustinmono commented Apr 15, 2020

mohamedelashhab commented Apr 15, 2020

mohamedelashhab commented Apr 15, 2020 • edited Loading

agustinmono commented Apr 15, 2020

agustinmono commented Apr 15, 2020

mohamedelashhab commented Apr 16, 2020

agustinmono commented Apr 16, 2020

mohamedelashhab commented Apr 16, 2020 • edited Loading

agustinmono commented Apr 16, 2020

mohamedelashhab commented Apr 21, 2020

rabser commented Apr 21, 2020 • edited Loading

mohamedelashhab commented Apr 22, 2020

rabser commented Apr 22, 2020

mohamedelashhab commented Apr 22, 2020 • edited Loading

revdsam commented Apr 24, 2020

farhatahmad commented Apr 24, 2020

AminaSaif commented May 17, 2020 • edited Loading

german2209 commented Jun 28, 2020

rexon07 commented Aug 7, 2020

rohitcoder commented Sep 4, 2020

andrekutianski commented Dec 5, 2020

ontimond commented Feb 18, 2021

uzeportal commented Aug 7, 2021 • edited Loading

mohamedelashhab commented Aug 9, 2021

mohamedelashhab commented Aug 9, 2021

uzeportal commented Aug 9, 2021 • edited Loading

mohamedelashhab commented Aug 9, 2021

fmasoudy commented Aug 31, 2021 • edited Loading

harika1258 commented Sep 4, 2021

fmasoudy commented Sep 4, 2021 via email

harika1258 commented Sep 4, 2021 • edited Loading

fmasoudy commented Sep 5, 2021 via email

harika1258 commented Sep 5, 2021

khaclamxd commented Mar 3, 2024

agustinmono commented Apr 11, 2020 •

edited

Loading

secretreal26 commented Apr 12, 2020 •

edited

Loading

mohamedelashhab commented Apr 15, 2020 •

edited

Loading

mohamedelashhab commented Apr 15, 2020 •

edited

Loading

mohamedelashhab commented Apr 16, 2020 •

edited

Loading

rabser commented Apr 21, 2020 •

edited

Loading

mohamedelashhab commented Apr 22, 2020 •

edited

Loading

AminaSaif commented May 17, 2020 •

edited

Loading

uzeportal commented Aug 7, 2021 •

edited

Loading

uzeportal commented Aug 9, 2021 •

edited

Loading

fmasoudy commented Aug 31, 2021 •

edited

Loading

harika1258 commented Sep 4, 2021 •

edited

Loading