Commit Graph

836 Commits

Author SHA1 Message Date
Chocobozzz 9b3294a849 Fix some build scripts and lint 2021-12-16 10:08:43 +01:00
lutangar b8fa3e8c73 refactor(types): create dedicated folder for types package src
fix guide examples and add types package readme

refactor(tsconfig): move back base tsconfig to base directory
2021-12-16 10:08:43 +01:00
lutangar 8b03e2ce1a feat(types): create peertube-types package
Create dedicated Typescript "types" configuration file for each "projects".
Create a types folder which includes every useful ts definition:
- client
- server
- shared
Add tooling to create a proper package, extract dependencies, etc...
Add CI Github task.

refactor(types): publish types package in release script
2021-12-16 10:08:43 +01:00
Chocobozzz 3cf68b869d
Ability for admins to set default upload values 2021-12-14 17:17:01 +01:00
Chocobozzz 11e520b50d
Fix tests doc 2021-12-13 11:17:49 +01:00
Chocobozzz 03a65456f4
Add 'input-checkbox' value warning in doc 2021-12-10 14:13:33 +01:00
Chocobozzz a23f6c94ed
Improve production guide
Add syntax highlighting
Add emoji on section titles to better differenciate each section
2021-12-08 09:44:14 +01:00
Chocobozzz bdf70330e4
Add account block status in openapi 2021-12-07 11:30:53 +01:00
Chocobozzz 14a07e0176
Increase yarn timeout
It can be slow when building docker using qemu
2021-12-06 08:57:10 +01:00
Chocobozzz 51e9e152f7
Build nightly using github action 2021-12-03 10:14:17 +01:00
Chocobozzz 37cb07eae2
Add missing docker credentials env 2021-12-02 09:21:19 +01:00
Chocobozzz af48e345be
Update release doc 2021-11-30 08:36:34 +01:00
Chocobozzz 8afade2607
Introduce plugin id selectors 2021-11-26 17:36:55 +01:00
Chocobozzz c95954261d
Use master branch for docker install documentation 2021-11-25 14:50:39 +01:00
lutangar 7226e90fdc Add `req` and `res` as controllers hooks parameters
Hooks prefixed by `action:api` now give access the original express req and res.
Checkout guide.md for possible usage.
2021-11-25 09:54:22 +01:00
Chocobozzz 450de91e22
Fix E2E tests 2021-11-24 10:49:12 +01:00
Chocobozzz ad5db1044c
Add ability to run transcoding jobs 2021-11-18 15:20:57 +01:00
Chocobozzz 1606ac207d
Migrate docker image to bullseye 2021-11-16 17:03:44 +01:00
Chocobozzz 61a4bad51e
Update localization doc 2021-11-15 15:57:46 +01:00
Chocobozzz 5638df0895
Update xliffmerge 2021-11-15 15:56:58 +01:00
Chocobozzz 527a52ac42
Add ability to filter out public videos from admin 2021-11-12 14:23:22 +01:00
Chocobozzz 51353d9a03 Refactor video views
Introduce viewers attribute for live videos
Count views for live videos
Reduce delay to see the viewer update for lives
Add ability to configure video views buffer interval and view ip
expiration
2021-11-09 15:00:31 +01:00
Chocobozzz 221ee1adc9 Add transcoding fail message in client 2021-11-09 15:00:21 +01:00
Chocobozzz 9c39161203
Add version note for create-move-video-storage-job 2021-11-09 14:41:18 +01:00
Florian CUNY 817c34d57c Trigger rebuild of Gitpod's image for PeerTube
Gitpod's docker image for PeerTube hasn't been rebuilt for some time, and started to have compatibility issues between dependencies and the node engine. Triggering this rebuild should force Gitpod to rebuild the image with node v16.13.0 instead of node v12.20.0.
2021-11-09 11:37:47 +01:00
kontrollanten e1ab52d7ec
Add migrate-to-object-storage script (#4481)
* add migrate-to-object-storage-script

closes #4467

* add migrate-to-unique-playlist-filenames script

* fix(migrate-to-unique-playlist-filenames): update master/segments256

run updateMasterHLSPlaylist and updateSha256VODSegments after
file rename.

* Improve move to object storage scripts

* PR remarks

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-11-09 11:05:35 +01:00
Chocobozzz df1db951c5
Support RTMPS 2021-11-05 11:38:17 +01:00
Florian CUNY 8dd754c767
Added 144p encoding (#4492)
* Added 144p encoding

Implements https://github.com/Chocobozzz/PeerTube/issues/4428

* Fixed typo in core-utils

* Increased BitPerPixel for 144p

* Disabled 144p by default in test.yaml

* Another try at fixing tests

* Fixed test in video-transcoder (api-3)

* Fixed test in video-imports (api-4)

* Fixed test in live-constraints (api-2)

* Tried to fix tests in api-3 again

* Revert "Tried to fix tests in api-3 again"

This reverts commit 266e1143fa37f333d149c2c2791c7bd33621ac14.

* Fixed test in config.ts (api-2)

* Try to fix test in video-hls.ts (api-3)

* Fixed test in video-transcoder.ts (api-3)

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-11-05 10:23:02 +01:00
Chocobozzz d324756edb
Add ability to filter by file type 2021-11-03 11:32:41 +01:00
Chocobozzz 7e7d8e4853
Some fixes for admin videos list 2021-11-02 11:13:13 +01:00
Chocobozzz 9883e60f30
Improve tests documentation 2021-11-02 10:13:53 +01:00
Chocobozzz 2760b454a7 Deprecate filter video query
Introduce include and isLocal instead
2021-10-29 11:48:21 +02:00
Frank Sträter 3a63b110ba Update RHEL8 Python symlinking 2021-10-26 09:10:12 +02:00
Rigel Kent 276250f0a3
prevent multiple post-process triggering of upload-resumable (#4175)
* prevent multiple post-process triggering of upload-resumable

* switch from 409 to 503 for upload being processed

* Improve resumable upload check

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-10-25 17:42:20 +02:00
Chocobozzz 7f91ecbde4
Completely remove torrent static path 2021-10-22 10:32:53 +02:00
Chocobozzz 62549e6c98
Rewrite youtube-dl import
Use python3 binary
Allows to use a custom youtube-dl release URL
Allows to use yt-dlp (youtube-dl fork)
Remove proxy config from configuration to use HTTP_PROXY and HTTPS_PROXY
env variables
2021-10-22 10:25:24 +02:00
Chocobozzz 97b6428af7
Breaking: fix inconsistencies in configuration 2021-10-20 16:29:41 +02:00
Chocobozzz 906f46d084
Split check user params tests 2021-10-20 09:25:44 +02:00
JustAnotherArchivist 9c58375c08 Add missing start and count parameters to playlist video list API endpoint documentation 2021-10-20 08:55:32 +02:00
Chocobozzz cf0c8ee588
Fix admin edition disabling feature 2021-10-14 11:35:43 +02:00
frankstrater a232d3e50b Add python-exec to Gentoo dependencies 2021-10-13 09:18:45 +02:00
kontrollanten c80e458afb
extend client-overrides with default images (#4392)
* extend client-overrides with default images

Add:
* default-playlist.png
* default-avatar-account.png
* default-avatar-videochannel.png

solves #4108

* Rename to default-avatar-video-channel.png

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-10-12 13:50:40 +02:00
Jelle Besseling 8d8a037e3f
Allow configuration to be static/readonly (#4315)
* Allow configuration to be static/readonly

* Make all components disableable

* Improve disabled component styling

* Rename edits allowed field in configuration

* Fix CI
2021-10-12 13:33:44 +02:00
Chocobozzz d00e9c54f3
Merge branch 'next' into develop 2021-10-11 09:37:30 +02:00
frankstrater 32e06ca4de Add Python symlink step for Gentoo 2021-10-08 14:54:37 +02:00
SansPseudoFix 461bcc1ab9 Add warning about community maintenance for dependencies 2021-10-08 14:53:20 +02:00
Chocobozzz 624e42fdf9
Remove peertube watch and peertube repl
I don't have time to maintain these scripts that cause some install
issues/maintenance difficulties
2021-09-10 15:06:57 +02:00
Chocobozzz 188aa7740c
Add restart peertube info in upgrade doc 2021-09-09 11:04:57 +02:00
Chocobozzz 29b84d749e
Improve release doc 2021-09-09 09:36:36 +02:00
Chocobozzz 6f9719b568
Add dev lib documentation 2021-09-07 11:47:40 +02:00
Chocobozzz dbe91db73e
Remove old s3 method nginx config 2021-09-07 09:37:43 +02:00
Chocobozzz 6d210220be
Fix NSFW filter and add tests 2021-09-03 16:35:18 +02:00
Chocobozzz 4d557df51c
Add note about global python 2021-09-02 11:54:13 +02:00
Chocobozzz 12d6b873cd
Improve e2e workflow and add doc 2021-09-02 09:07:42 +02:00
Chocobozzz 2a21507a38
Update changelog 2021-08-27 11:18:06 +02:00
Chocobozzz 8f58172565
Allow accounts to skip account setup modal 2021-08-27 10:15:55 +02:00
Chocobozzz d35f3a86c6
Fix archlinux dep 2021-08-26 10:01:42 +02:00
Frank Sträter 644800ef55
Dependencies RHEL8 (#4337)
* Add guide for RHEL 8

* Remove hash comments in shell scripts to avoid root prompt confusion
2021-08-24 11:51:04 +02:00
Chocobozzz 66a7fc9473
Remove optimize old videos script
It is not compatible with HLS and I don't have time to maintain it
2021-08-17 10:33:36 +02:00
Jelle Besseling 0305db28c9
Add support for saving video files to object storage (#4290)
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-17 08:26:20 +02:00
ROBERT MCDOWELL da948b75ca Standard output type syslog is obsolete in systemed
removing the setting
StandardOutput
StandardError
2021-08-05 10:58:05 +02:00
Chocobozzz 2bee9db56a
Update plugin doc 2021-07-30 13:58:18 +02:00
WingsLikeEagles f68d1cb6ac Adding Rocky Linux 8.4
Adding documentation for Rocky Linux 8.4
Adapted from CentOS 8... but seems like there is stuff missing from that section.
2021-07-28 08:11:57 +02:00
Chocobozzz a24bd1ed41
Merge branch 'next' into develop 2021-07-21 15:51:30 +02:00
Chocobozzz 5f26f13b3c
Merge branch 'constant-registry' into develop 2021-07-21 15:45:42 +02:00
Chocobozzz 4d029ef8ec
Add ability for instances to follow any actor 2021-07-21 13:35:31 +02:00
Chocobozzz f49ff55162
Bumped to version v3.3.0 2021-07-20 15:08:50 +02:00
lutangar dc3d902234 Introduce generic video constant manager for plugins
Allow a plugin developer to get back constants values,
and reset constants deletions or additions.
2021-07-16 17:49:40 +02:00
Frank Sträter 39072b2f6a
Postgresql-setup init option for auth-host (#4253)
* Set postgresql password authentication for host

* Update postgresql-setup obsoleted argument syntax for initdb
2021-07-16 15:39:09 +02:00
jameskimmel 1d8400118a Update dependencies.md
The now LTS version of NodeJS is 14.x
2021-07-12 15:33:14 +02:00
Frank Sträter 8182a37067
Fedora guide fix (#4238)
* Fix peertube sudoer

* Add vim to Fedora packages installation

* Add oidentd to Fedora packages installation

* Enable and start the ident daemon

* Add nginx configuration

* Add future symbolic link for nginx config

* Add small change for Gentoo
2021-07-12 15:31:57 +02:00
Chocobozzz deecf33724
Bumped to version v3.3.0-rc.1 2021-07-05 15:19:45 +02:00
lutangar 4c0a6954fb Document a way to update the last available version of a plugin manually
May comes in very handy to quickly test a plugin in a production like environment before it reaches a greater world.

> This magic trick comes from @Chocobozzz himself, who passed it on to @JohnXLivingston, who then passed it down to me.
2021-06-30 11:44:54 +02:00
Chocobozzz d4a8e7a65f Support short uuid for GET video/playlist 2021-06-29 14:56:35 +02:00
frankstrater 2370d9cc4a Add downloadEnabled boolean to PUT video 2021-06-25 15:00:21 +02:00
Chocobozzz 37a44fc915 Add ability to search playlists 2021-06-25 14:44:01 +02:00
Chocobozzz 754c73f32b
Improve plugin guide doc for plugin index 2021-06-08 17:57:33 +02:00
Rigel Kent 37ede348bb
(doc) add note in config that tmp is also used while processing 2021-06-08 11:45:03 +02:00
Chocobozzz a13df19d57
Increase max image/caption/torrent upload size 2021-06-08 10:01:50 +02:00
Chocobozzz 8beea2d37d
Add ability to filter menu links 2021-06-07 13:20:08 +02:00
Rigel Kent c756bae079
add video upload types, add doc middleware to more routes 2021-06-06 10:21:06 +02:00
Rigel Kent a31e9b183e
add invalid_token error to openapi spec 2021-06-04 08:40:08 +02:00
John Livingston 9777fe9eeb
Adding frontend peertubeHelpers.getBaseRouterRoute. (#4153)
* Adding frontend peertubeHelpers.getBaseRouterRoute.

* Fix doctoc.
2021-06-03 12:28:26 +02:00
Rigel Kent 81628e5069 refactor error code values for URI compatibility 2021-06-02 16:57:07 +02:00
Rigel Kent 1cfbdd30d9 refactor deprecated body-parser usage 2021-06-02 16:57:07 +02:00
Rigel Kent 76148b27f7 refactor API errors to standard error format 2021-06-02 16:57:07 +02:00
Rigel Kent 3dd6d6cd42
move dependencies link to engines.yaml 2021-06-02 10:48:03 +02:00
Johan Fleury 383fea89f0 Allow setting log level using PEERTUBE_LOG_LEVEL envvar 2021-06-02 09:43:13 +02:00
Chocobozzz 1a148b4792
Bumped to version v3.2.1 2021-06-01 11:03:52 +02:00
Chocobozzz c215e627b5
Fix openapi doc for resumable upload 2021-05-27 16:06:24 +02:00
Chocobozzz 2539932e16
Instance homepage support (#4007)
* Prepare homepage parsers

* Add ability to update instance hompage

* Add ability to set homepage as landing page

* Add homepage preview in admin

* Dynamically update left menu for homepage

* Inject home content in homepage

* Add videos list and channel miniature custom markup

* Remove unused elements in markup service
2021-05-27 15:59:55 +02:00
Chocobozzz eb34ec30e0
Merge branch 'release/3.2.0' into develop 2021-05-27 14:04:15 +02:00
Chocobozzz 4e67a45cd9
Bumped to version v3.2.0 2021-05-27 13:56:49 +02:00
Chocobozzz 85a60d8beb
Fix broken openapi schema 2021-05-27 11:52:03 +02:00
Rigel Kent e2adb8cb40
add operationId to common operations 2021-05-26 14:24:51 +02:00
Chocobozzz 3dc8a86c80
cd /var/www/peertube in prod guide
Avoid running db creation in /root directory
2021-05-25 11:35:29 +02:00
Chocobozzz 31a911190b
Fix broadcast message log level 2021-05-25 11:35:29 +02:00
Stakovicz 78c5e31049
Allow SSL database parameter (#4114)
* Allow SSL database parameter

Allow SSL database parameter via environment variable

* Allow SSL database parameter 

Allow SSL database parameter via environment variable

* Update support/docker/production/config/custom-environment-variables.yaml

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>

Co-authored-by: Chocobozzz <chocobozzz@cpy.re>
2021-05-25 11:35:29 +02:00
Chocobozzz 6a3391bced
cd /var/www/peertube in prod guide
Avoid running db creation in /root directory
2021-05-25 11:34:43 +02:00
Chocobozzz 008af5c9bb
Fix broadcast message log level 2021-05-25 11:34:43 +02:00