Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

handler

package

v0.0.0-...-eb0ee05 Latest Latest Go to latest Published: Sep 27, 2021 License: Apache-2.0 Imports: 11 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/DataWorkbench/logmanager

Links

Open Source Insights

Documentation ¶

Index ¶

Variables
func CheckJobManagerLogFile(baseServerURL, destPrePath string) (isCompleted bool, err error)
func CheckTaskManagerLogFiles(baseServerURL, destPrePath string) (bool, error)
func CheckUploadingTask(baseServerURL, destPrePath string) (*logpb.TaskStatReply, error)
func DownloadLogFile(filePath string, stream logpb.LogManager_DownloadJobMgrLogFileServer) (err error)
func GetJobManagerFilePathInHDFS(destPreDirPath, fileName string) string
func GetTaskManagerFilePathInHDFS(destPreDirPath, fileName, taskManagerID string) string
func Init(opts ...Option)
func ListHistoryLogFiles(dirPath string) ([]os.FileInfo, error)
func UploadLogFile(baseServerURL, destPrePath string) (*logpb.UploadFileReply, error)
type FileDataBlock
type Option
- func WithHdfsConfig(hc *config.HdfsConfig) Option
- func WithLogger(lp *glog.Logger) Option

Constants ¶

This section is empty.

Variables ¶

View Source

var (
	HdfsServerConfig *config.HdfsConfig
)

global options in this package.

Functions ¶

func CheckJobManagerLogFile ¶

func CheckJobManagerLogFile(baseServerURL, destPrePath string) (isCompleted bool, err error)

func CheckTaskManagerLogFiles ¶

func CheckTaskManagerLogFiles(baseServerURL, destPrePath string) (bool, error)

func CheckUploadingTask ¶

func CheckUploadingTask(baseServerURL, destPrePath string) (*logpb.TaskStatReply, error)

func DownloadLogFile ¶

func DownloadLogFile(filePath string, stream logpb.LogManager_DownloadJobMgrLogFileServer) (err error)

func GetJobManagerFilePathInHDFS ¶

func GetJobManagerFilePathInHDFS(destPreDirPath, fileName string) string

func GetTaskManagerFilePathInHDFS ¶

func GetTaskManagerFilePathInHDFS(destPreDirPath, fileName, taskManagerID string) string

func Init ¶

func Init(opts ...Option)

func ListHistoryLogFiles ¶

func ListHistoryLogFiles(dirPath string) ([]os.FileInfo, error)

func UploadLogFile ¶

func UploadLogFile(baseServerURL, destPrePath string) (*logpb.UploadFileReply, error)

try to download log file from baseServerURL (flink web restful) and upload file to destPrePath in HDFS

Types ¶

type FileDataBlock ¶

type FileDataBlock struct {
	Data []byte
	Err  error
}

type Option ¶

type Option func()

func WithHdfsConfig ¶

func WithHdfsConfig(hc *config.HdfsConfig) Option

func WithLogger ¶

func WithLogger(lp *glog.Logger) Option

Source Files ¶

View all Source files