Solving the pooling problem at scale with extensible solver GALINI. This paper presents a Python library to model pooling problems, a class of network flow problems with many engineering applications. The library automatically generates a mixed integer quadratically constrained quadratic optimization problem from a given network structure. The library additionally uses the network structure to build 1) a convex linear relaxation of the non convex quadratic program and 2) a mixed integer linear restriction of the problem. We integrate the pooling network library with galini, an open source extensible global solver for quadratic optimization. We demonstrate galini's extensible characteristics by using the pooling library to develop two galini plug ins 1) a cut generator plug in that adds valid inequalities in the galini cut loop and 2) a primal heuristic plug in that uses the mixed integer linear restriction. We test galini on large scale pooling problems and show that, thanks to the good upper bound provided by the mixed integer linear restriction and the good lower bounds provided by the convex relaxation, we obtain optimality gaps that are competitive with Gurobi 9.1 on the largest problem instances.


A Shadowcasting Based Next Best View Planner for Autonomous 3D Exploration. In this paper, we address the problem of autonomous exploration of unknown environments with an aerial robot equipped with a sensory set that produces large point clouds, such as LiDARs. The main goal is to gradually explore an area while planning paths and calculating information gain in short computation time, suitable for implementation on an on board computer. To this end, we present a planner that randomly samples viewpoints in the environment map. It relies on a novel and efficient gain calculation based on the Recursive Shadowcasting algorithm. To determine the Next Best View (NBV), our planner uses a cuboid based evaluation method that results in an enviably short computation time. To reduce the overall exploration time, we also use a dead end resolving strategy that allows us to quickly recover from dead ends in a challenging environment. Comparative experiments in simulation have shown that our approach outperforms the current state of the art in terms of computational efficiency and total exploration time. The video of our approach can be found at https www.youtube.com playlist?list PLC0C6uwoEQ8ZDhny1VdmFXLeTQOSBibQl.


Voxel based Network for Shape Completion by Leveraging Edge Generation. Deep learning technique has yielded significant improvements in point cloud completion with the aim of completing missing object shapes from partial inputs. However, most existing methods fail to recover realistic structures due to over smoothing of fine grained details. In this paper, we develop a voxel based network for point cloud completion by leveraging edge generation (VE PCN). We first embed point clouds into regular voxel grids, and then generate complete objects with the help of the hallucinated shape edges. This decoupled architecture together with a multi scale grid feature learning is able to generate more realistic on surface details. We evaluate our model on the publicly available completion datasets and show that it outperforms existing state of the art approaches quantitatively and qualitatively. Our source code is available at https github.com xiaogangw VE PCN.


Some properties of almost summing operators. In this paper we extend the scope of three important results of the linear theory of absolutely summing operators. The first one was proved by Bu and Kranz in cite BK and it asserts that a continuous linear operator between Banach spaces takes almost unconditionally summable sequences into Cohen strongly q summable sequences for any q geq2 , whenever its adjoint is p summing for some p geq1 . The second of them states that p summing operators with hilbertian domain are Cohen strongly q summing operators ( 1 p,q infty ), this result is due to Bu cite Bu . The third one is due to Kwapie ' n cite Kwapien and it characterizes spaces isomorphic to a Hilbert space using 2 summing operators. We will show that these results are maintained replacing the hypothesis of the operator to be p summing by almost summing. We will also give an example of an almost summing operator that fails to be p summing for every 1 leq p infty .


Detect Faces Efficiently A Survey and Evaluations. Face detection is to search all the possible regions for faces in images and locate the faces if there are any. Many applications including face recognition, facial expression recognition, face tracking and head pose estimation assume that both the location and the size of faces are known in the image. In recent decades, researchers have created many typical and efficient face detectors from the Viola Jones face detector to current CNN based ones. However, with the tremendous increase in images and videos with variations in face scale, appearance, expression, occlusion and pose, traditional face detectors are challenged to detect various "in the wild" faces. The emergence of deep learning techniques brought remarkable breakthroughs to face detection along with the price of a considerable increase in computation. This paper introduces representative deep learning based methods and presents a deep and thorough analysis in terms of accuracy and efficiency. We further compare and discuss the popular and challenging datasets and their evaluation metrics. A comprehensive comparison of several successful deep learning based face detectors is conducted to uncover their efficiency using two metrics FLOPs and latency. The paper can guide to choose appropriate face detectors for different applications and also to develop more efficient and accurate detectors.


A high order L2 type difference scheme for the time fractional diffusion equation. The present paper is devoted to constructing L2 type difference analog of the Caputo fractional derivative. The fundamental features of this difference operator are studied and it is used to construct difference schemes generating approximations of the second and fourth order in space and the (3 alpha) th order in time for the time fractional diffusion equation with variable coefficients. Stability of the schemes under consideration as well as their convergence with the rate equal to the order of the approximation error are proven. The received results are supported by the numerical computations performed for some test problems.


TransSC Transformer based Shape Completion for Grasp Evaluation. Currently, robotic grasping methods based on sparse partial point clouds have attained a great grasping performance on various objects while they often generate wrong grasping candidates due to the lack of geometric information on the object. In this work, we propose a novel and robust shape completion model (TransSC). This model has a transformer based encoder to explore more point wise features and a manifold based decoder to exploit more object details using a partial point cloud as input. Quantitative experiments verify the effectiveness of the proposed shape completion network and demonstrate it outperforms existing methods. Besides, TransSC is integrated into a grasp evaluation network to generate a set of grasp candidates. The simulation experiment shows that TransSC improves the grasping generation result compared to the existing shape completion baselines. Furthermore, our robotic experiment shows that with TransSC the robot is more successful in grasping objects that are randomly placed on a support surface.


DepMiner A Pipelineable Tool for Mining of Intra Project Dependencies. Dependency analysis is recognized as an important field of software engineering due to a variety of reasons. There exists a large pool of tools providing assistance to software developers and architects. Analysis of inter and intra project dependencies can help provide various insights about the entire development process. There is, however, currently a lack of tools that would support researchers by extracting intra project dependencies data in a format most suited for further analysis. In this paper we introduce DepMiner an open source, language agnostic tool for mining detailed dependencies data from source code, based on extensive static analysis capabilities of an industry standard IDE. DepMiner can be easily integrated into arbitrary mining pipelines to conduct large scale source code processing jobs involving intra project dependencies. It is easily extensible to support other languages of source code, different granularities of analysis, and other use specific needs.


On super recurrent operators. In this paper, we introduce and study the notion of super recurrence of operators. We investigate some properties of this class of operators and show that it shares some characteristics with supercyclic and recurrent operators. In particular, we show that if T is super recurrent, then sigma(T) and sigma p(T ) , the spectrum of T and the point spectrum of T respectively, have some noteworthy properties.


A Novel Convergence Analysis for Algorithms of the Adam Family. Since its invention in 2014, the Adam optimizer has received tremendous attention. On one hand, it has been widely used in deep learning and many variants have been proposed, while on the other hand their theoretical convergence property remains to be a mystery. It is far from satisfactory in the sense that some studies require strong assumptions about the updates, which are not necessarily applicable in practice, while other studies still follow the original problematic convergence analysis of Adam, which was shown to be not sufficient to ensure convergence. Although rigorous convergence analysis exists for Adam, they impose specific requirements on the update of the adaptive step size, which are not generic enough to cover many other variants of Adam. To address theses issues, in this extended abstract, we present a simple and generic proof of convergence for a family of Adam style methods (including Adam, AMSGrad, Adabound, etc.). Our analysis only requires an increasing or large "momentum" parameter for the first order moment, which is indeed the case used in practice, and a boundness condition on the adaptive factor of the step size, which applies to all variants of Adam under mild conditions of stochastic gradients. We also establish a variance diminishing result for the used stochastic gradient estimators. Indeed, our analysis of Adam is so simple and generic that it can be leveraged to establish the convergence for solving a broader family of non convex optimization problems, including min max, compositional, and bilevel optimization problems. For the full (earlier) version of this extended abstract, please refer to arXiv 2104.14840.


A Survey on Locality Sensitive Hashing Algorithms and their Applications. Finding nearest neighbors in high dimensional spaces is a fundamental operation in many diverse application domains. Locality Sensitive Hashing (LSH) is one of the most popular techniques for finding approximate nearest neighbor searches in high dimensional spaces. The main benefits of LSH are its sub linear query performance and theoretical guarantees on the query accuracy. In this survey paper, we provide a review of state of the art LSH and Distributed LSH techniques. Most importantly, unlike any other prior survey, we present how Locality Sensitive Hashing is utilized in different application domains.


PatchNet Unsupervised Object Discovery based on Patch Embedding. We demonstrate that frequently appearing objects can be discovered by training randomly sampled patches from a small number of images (100 to 200) by self supervision. Key to this approach is the pattern space, a latent space of patterns that represents all possible sub images of the given image data. The distance structure in the pattern space captures the co occurrence of patterns due to the frequent objects. The pattern space embedding is learned by minimizing the contrastive loss between randomly generated adjacent patches. To prevent the embedding from learning the background, we modulate the contrastive loss by color based object saliency and background dissimilarity. The learned distance structure serves as object memory, and the frequent objects are simply discovered by clustering the pattern vectors from the random patches sampled for inference. Our image representation based on image patches naturally handles the position and scale invariance property that is crucial to multi object discovery. The method has been proven surprisingly effective, and successfully applied to finding multiple human faces and bodies from natural images.


Compact homogeneous locally conformally Kahler manifolds are Vaisman. A new proof. An LCK manifold with potential is a complex manifold with a Kahler potential on its cover, such that any deck transformation multiplies the Kahler potential by a constant multiplier. We prove that any homogeneous LCK manifold admits a metric with LCK potential. This is used to give a new proof that any compact homogeneous LCK manifold is Vaisman.


Parallel Batch Dynamic k Core Decomposition. Maintaining a k core decomposition quickly in a dynamic graph is an important problem in many applications, including social network analytics, graph visualization, centrality measure computations, and community detection algorithms. The main challenge for designing efficient k core decomposition algorithms is that a single change to the graph can cause the decomposition to change significantly. We present the first parallel batch dynamic algorithm for maintaining an approximate k core decomposition that is efficient in both theory and practice. Given an initial graph with m edges, and a batch of B updates, our algorithm maintains a (2 delta) approximation of the coreness values for all vertices (for any constant delta 0 ) in O(B log 2 m) amortized work and O( log 2 m log log m) depth (parallel time) with high probability. Our algorithm also maintains a low out degree orientation of the graph in the same bounds. We implemented and experimentally evaluated our algorithm on a 30 core machine with two way hyper threading on 11 graphs of varying densities and sizes. Compared to the state of the art algorithms, our algorithm achieves up to a 114.52x speedup against the best multicore implementation and up to a 497.63x speedup against the best sequential algorithm, obtaining results for graphs that are orders of magnitude larger than those used in previous studies. In addition, we present the first approximate static k core algorithm with linear work and polylogarithmic depth. We show that on a 30 core machine with two way hyper threading, our implementation achieves up to a 3.9x speedup in the static case over the previous state of the art parallel algorithm.


Anatomy of a superorganism structure and growth dynamics of army ant bivouacs. Beyond unicellular and multicellular organisms, there is a third type of structural complexity in living animals that of the mechanical self assembly of groups of distinct multicellular organisms into dynamical, functional structures. One of the most striking examples of such structures is the army ant bivouac, a nest which self assembles solely from the interconnected bodies of hundreds of thousands of individuals. These bivouacs are difficult to study because they rapidly disassemble when disturbed, and hence little is known about the structure and rules that individuals follow during their formation. Here we use a custom built Computed Tomography scanner to investigate the details of the internal structure and growth process of army ant bivouacs. We show that bivouacs are heterogeneous structures, which throughout their growth maintain a thick shell surrounding a less dense interior that contains empty spaces akin to nest chambers. We find that ants within the bivouac do not carry more than approximately eight times their weight regardless of the size of the structure or their position within it. This observation suggests that bivouac size is not limited by physical constraints of the ants' morphology. This study brings us closer to understanding the rules used by individuals to govern the formation of these exceptional superorganismal structures, and provides insight into how to create engineered self assembling systems with, for instance, swarms of robots or active matter.


Extrema of Luroth Digits and a zeta function limit relation. We describe how certain properties of the extrema of the digits of Luroth expansions lead to a probabilistic proof of a limiting relation involving the Riemann zeta function and the Bernoulli triangles. We also discuss trimmed sums of Luroth digits. Our goal is to show how direct computations in this case lead to explicit formulas and some interesting discussions of special functions.


Fairness aware Class Imbalanced Learning. Class imbalance is a common challenge in many NLP tasks, and has clear connections to bias, in that bias in training data often leads to higher accuracy for majority groups at the expense of minority groups. However there has traditionally been a disconnect between research on class imbalanced learning and mitigating bias, and only recently have the two been looked at through a common lens. In this work we evaluate long tail learning methods for tweet sentiment and occupation classification, and extend a margin loss based approach with methods to enforce fairness. We empirically show through controlled experiments that the proposed approaches help mitigate both class imbalance and demographic biases.


DeepRT A Soft Real Time Scheduler for Computer Vision Applications on the Edge. The ubiquity of smartphone cameras and IoT cameras, together with the recent boom of deep learning and deep neural networks, proliferate various computer vision driven mobile and IoT applications deployed on the edge. This paper focuses on applications which make soft real time requests to perform inference on their data they desire prompt responses within designated deadlines, but occasional deadline misses are acceptable. Supporting soft real time applications on a multi tenant edge server is not easy, since the requests sharing the limited GPU computing resources of an edge server interfere with each other. In order to tackle this problem, we comprehensively evaluate how latency and throughput respond to different GPU execution plans. Based on this analysis, we propose a GPU scheduler, DeepRT, which provides latency guarantee to the requests while maintaining high overall system throughput. The key component of DeepRT, DisBatcher, batches data from different requests as much as possible while it is proven to provide latency guarantee for requests admitted by an Admission Control Module. DeepRT also includes an Adaptation Module which tackles overruns. Our evaluation results show that DeepRT outperforms state of the art works in terms of the number of deadline misses and throughput.


Separating Geometric Data with Minimum Cost Two Disjoint Convex Hulls. In this study, a geometric version of an NP hard problem ("Almost 2 SAT " problem) is introduced which has potential applications in clustering, separation axis, binary sensor networks, shape separation, image processing, etc. Furthermore, it has been illustrated that the new problem known as "Two Disjoint Convex Hulls" can be solved in polynomial time due to some combinatorial aspects and geometric properties. For this purpose, an O(n 2) algorithm has also been presented which employs the Separating Axis Theorem (SAT) and the duality of points lines.


Integer programs with bounded subdeterminants and two nonzeros per row. We give a strongly polynomial time algorithm for integer linear programs defined by integer coefficient matrices whose subdeterminants are bounded by a constant and that contain at most two nonzero entries in each row. The core of our approach is the first polynomial time algorithm for the weighted stable set problem on graphs that do not contain more than k vertex disjoint odd cycles, where k is any constant. Previously, polynomial time algorithms were only known for k 0 (bipartite graphs) and for k 1 . We observe that integer linear programs defined by coefficient matrices with bounded subdeterminants and two nonzeros per column can be also solved in strongly polynomial time, using a reduction to b matching.


A Reduced Order Controller for Output Tracking of a Kelvin Voigt Beam. We study output tracking and disturbance rejection for an Euler Bernoulli beam with Kelvin Voigt damping. The system has distributed control and pointwise observation. As our main result we design a finite dimensional low order internal model based controller that is based on a spectral Galerkin method and model reduction by Balanced Truncation. The performance of the designed controller is demonstrated with numerical simulations and compared to the performance of a low gain internal model based controller.


Probability driven scoring functions in combining linear classifiers. Although linear classifiers are one of the oldest methods in machine learning, they are still very popular in the machine learning community. This is due to their low computational complexity and robustness to overfitting. Consequently, linear classifiers are often used as base classifiers of multiple ensemble classification systems. This research is aimed at building a new fusion method dedicated to the ensemble of linear classifiers. The fusion scheme uses both measurement space and geometrical space. Namely, we proposed a probability driven scoring function which shape depends on the orientation of the decision hyperplanes generated by the base classifiers. The proposed fusion method is compared with the reference method using multiple benchmark datasets taken from the KEEL repository. The comparison is done using multiple quality criteria. The statistical analysis of the obtained results is also performed. The experimental study shows that, under certain conditions, some improvement may be obtained.


DeepFake MNIST A DeepFake Facial Animation Dataset. The DeepFakes, which are the facial manipulation techniques, is the emerging threat to digital society. Various DeepFake detection methods and datasets are proposed for detecting such data, especially for face swapping. However, recent researches less consider facial animation, which is also important in the DeepFake attack side. It tries to animate a face image with actions provided by a driving video, which also leads to a concern about the security of recent payment systems that reply on liveness detection to authenticate real users via recognising a sequence of user facial actions. However, our experiments show that the existed datasets are not sufficient to develop reliable detection methods. While the current liveness detector cannot defend such videos as the attack. As a response, we propose a new human face animation dataset, called DeepFake MNIST , generated by a SOTA image animation generator. It includes 10,000 facial animation videos in ten different actions, which can spoof the recent liveness detectors. A baseline detection method and a comprehensive analysis of the method is also included in this paper. In addition, we analyze the proposed dataset's properties and reveal the difficulty and importance of detecting animation datasets under different types of motion and compression quality.


A learning based approach to feature recognition of Engineering shapes. In this paper, we propose a machine learning approach to recognise engineering shape features such as holes, slots, etc. in a CAD mesh model. With the advent of digital archiving, newer manufacturing techniques such as 3D printing, scanning of components and reverse engineering, CAD data is proliferated in the form of mesh model representation. As the number of nodes and edges become larger in a mesh model as well as the possibility of presence of noise, direct application of graph based approaches would not only be expensive but also difficult to be tuned for noisy data. Hence, this calls for newer approaches to be devised for feature recognition for CAD models represented in the form of mesh. Here, we show that a discrete version of Gauss map can be used as a signature for a feature learning. We show that this approach not only requires fewer memory requirements but also the training time is quite less. As no network architecture is involved, the number of hyperparameters are much lesser and can be tuned in a much faster time. The recognition accuracy is also very similar to that of the one obtained using 3D convolutional neural networks (CNN) but in much lesser running time and storage requirements. A comparison has been done with other non network based machine learning approaches to show that our approach has the highest accuracy. We also show the recognition results for CAD models having multiple features as well as complex interacting features obtained from public benchmarks. The ability to handle noisy data has also been demonstrated.


Escape from parsimony of a double cut and join genome evolution process. We analyze models of genome evolution based on both restricted and unrestricted double cut and join (DCJ) operations. We compare the number of operations along the evolutionary trajectory to the DCJ distance of the genome from its ancestor at each step, and determine at what point they diverge the process escapes from parsimony. Adapting the method developed by Berestycki and Durret (2006), we estimate the number of cycles in the breakpoint graph of a random genome at time t and its ancestral genome by the number of tree components of an Erd "os R 'enyi random graph constructed from the model of evolution. In both models, the process on a genome of size n is bound to its parsimonious estimate up to t approx n 2 steps.


Mesosome Avoidance. We consider avoiding mesosomes that is, words of the form xx' with x' a conjugate of x that is different from x over a binary alphabet. We give a structure theorem for mesosome avoiding words, count how many there are, characterize all the infinite mesosome avoiding words, and determine the minimal forbidden words.


On Foulkes characters. Orthogonality relations for Foulkes characters of full monomial groups are presented, along with three solutions to the problem of decomposing products of these characters, and new applications, including a product reformulation of a Markov chain for adding random numbers studied by Diaconis and Fulman, and a new proof of a theorem of Zagier which generalizes one of Harer and Zagier on the enumeration of Riemann surfaces of a given genus.


On a generalization of Jacobi sums. We prove an estimate for multi variable multiplicative character sums over affine subspaces of mathbb A n k , which generalize the well known estimates for both classical Jacobi sums and one variable polynomial multiplicative character sums.


mathrm L p maximal regularity for parabolic and elliptic boundary value problems with boundary conditions of mixed differentiability orders. In the theory of non linear parabolic and elliptic partial differential equations, the notion of maximal regularity plays an essential role in establishing existence, regularity and boundedness of solutions. There is a long history of works where sufficient conditions for maximal regularity have been established First scalar equations and systems of finitely many coupled equations have been considered. Around 2000, the vector valued case with infinite dimensional range space E became accessible to the development and progress in theory of mathcal R bounded operator families and its close connection to the mathcal H infty calculus. The ground braking results by Denk, Hieber and Pr "uss for mathrm L p maximal regularity of vector valued parabolic and elliptic boundary value problems, however, were restricted to boundary conditions with homogeneous principle parts of the boundary symbol, in contrast to some previous results by Ladyszenskaya, Solonnikov and Uralceva for finite component systems which also allow for, e.g. both Dirichlet and (mixed) flux boundary conditions at the same position. In this manuscript we aim for closing this gap, and extend the results of Denk, Hieber and Pr "uss to this slightly more general situation. To this end, we closely review the strategy used in their works and adapt it to the situation considered here.


On the Explicit Role of Initialization on the Convergence and Implicit Bias of Overparametrized Linear Networks. Neural networks trained via gradient descent with random initialization and without any regularization enjoy good generalization performance in practice despite being highly overparametrized. A promising direction to explain this phenomenon is to study how initialization and overparametrization affect convergence and implicit bias of training algorithms. In this paper, we present a novel analysis of single hidden layer linear networks trained under gradient flow, which connects initialization, optimization, and overparametrization. Firstly, we show that the squared loss converges exponentially to its optimum at a rate that depends on the level of imbalance of the initialization. Secondly, we show that proper initialization constrains the dynamics of the network parameters to lie within an invariant set. In turn, minimizing the loss over this set leads to the min norm solution. Finally, we show that large hidden layer width, together with (properly scaled) random initialization, ensures proximity to such an invariant set during training, allowing us to derive a novel non asymptotic upper bound on the distance between the trained network and the min norm solution.


Predicting Physical World Destinations for Commands Given to Self Driving Cars. In recent years, we have seen significant steps taken in the development of self driving cars. Multiple companies are starting to roll out impressive systems that work in a variety of settings. These systems can sometimes give the impression that full self driving is just around the corner and that we would soon build cars without even a steering wheel. The increase in the level of autonomy and control given to an AI provides an opportunity for new modes of human vehicle interaction. However, surveys have shown that giving more control to an AI in self driving cars is accompanied by a degree of uneasiness by passengers. In an attempt to alleviate this issue, recent works have taken a natural language oriented approach by allowing the passenger to give commands that refer to specific objects in the visual scene. Nevertheless, this is only half the task as the car should also understand the physical destination of the command, which is what we focus on in this paper. We propose an extension in which we annotate the 3D destination that the car needs to reach after executing the given command and evaluate multiple different baselines on predicting this destination location. Additionally, we introduce a model that outperforms the prior works adapted for this particular setting.


Panoptic Segmentation A Review. Image segmentation for video analysis plays an essential role in different research fields such as smart city, healthcare, computer vision and geoscience, and remote sensing applications. In this regard, a significant effort has been devoted recently to developing novel segmentation strategies one of the latest outstanding achievements is panoptic segmentation. The latter has resulted from the fusion of semantic and instance segmentation. Explicitly, panoptic segmentation is currently under study to help gain a more nuanced knowledge of the image scenes for video surveillance, crowd counting, self autonomous driving, medical image analysis, and a deeper understanding of the scenes in general. To that end, we present in this paper the first comprehensive review of existing panoptic segmentation methods to the best of the authors' knowledge. Accordingly, a well defined taxonomy of existing panoptic techniques is performed based on the nature of the adopted algorithms, application scenarios, and primary objectives. Moreover, the use of panoptic segmentation for annotating new datasets by pseudo labeling is discussed. Moving on, ablation studies are carried out to understand the panoptic methods from different perspectives. Moreover, evaluation metrics suitable for panoptic segmentation are discussed, and a comparison of the performance of existing solutions is provided to inform the state of the art and identify their limitations and strengths. Lastly, the current challenges the subject technology faces and the future trends attracting considerable interest in the near future are elaborated, which can be a starting point for the upcoming research studies. The papers provided with code are available at https github.com elharroussomar Awesome Panoptic Segmentation


p complete mathrm arc descent for perfect complexes over integral perfectoid rings. We prove p complete mathrm arc descent results for finite projective modules and perfect complexes over integral perfectoid rings. Using our results, we clarify a reduction argument in the proof of the classification of p divisible groups over integral perfectoid rings given by Scholze Weinstein.


Clustering and attention model based for intelligent trading. The foreign exchange market has taken an important role in the global financial market. While foreign exchange trading brings high yield opportunities to investors, it also brings certain risks. Since the establishment of the foreign exchange market in the 20th century, foreign exchange rate forecasting has become a hot issue studied by scholars from all over the world. Due to the complexity and number of factors affecting the foreign exchange market, technical analysis cannot respond to administrative intervention or unexpected events. Our team chose several pairs of foreign currency historical data and derived technical indicators from 2005 to 2021 as the dataset and established different machine learning models for event driven price prediction for oversold scenario.


Intermediate planar algebra revisited, II. We describe the subfactor planar algebra of an intermediate subfactor N subset Q subset M of an extremal subfactor N subset M of finite Jones index which is not necessarily irreducible.


Generating Fake Cyber Threat Intelligence Using Transformer Based Models. Cyber defense systems are being developed to automatically ingest Cyber Threat Intelligence (CTI) that contains semi structured data and or text to populate knowledge graphs. A potential risk is that fake CTI can be generated and spread through Open Source Intelligence (OSINT) communities or on the Web to effect a data poisoning attack on these systems. Adversaries can use fake CTI examples as training input to subvert cyber defense systems, forcing the model to learn incorrect inputs to serve their malicious needs. In this paper, we automatically generate fake CTI text descriptions using transformers. We show that given an initial prompt sentence, a public language model like GPT 2 with fine tuning, can generate plausible CTI text with the ability of corrupting cyber defense systems. We utilize the generated fake CTI text to perform a data poisoning attack on a Cybersecurity Knowledge Graph (CKG) and a cybersecurity corpus. The poisoning attack introduced adverse impacts such as returning incorrect reasoning outputs, representation poisoning, and corruption of other dependent AI based cyber defense systems. We evaluate with traditional approaches and conduct a human evaluation study with cybersecurity professionals and threat hunters. Based on the study, professional threat hunters were equally likely to consider our fake generated CTI as true.


Amino acid frequency and domain features serve well for random forest based classification of thermophilic and mesophilic protein a case study on serine proteases. Thermostability is an important prerequisite for enzymes employed for industrial applications. Several machine learning based models have thus been formulated for protein classification based on this particular trait. These models have employed features derived from sequences, structures or both resulting in a 93 accuracy based on a 10 fold cross validation. Besides using various proteins from a wide range of organisms, such studies also rely on hundreds of features. In the present study, an enzyme specific classification model was created using significantly less number of features that provides a similar accuracy of classification for thermophilic and non thermophilic enzyme serine proteases. For building the classifier, 219 thermophilic and 200 mesophilic bacterial genomes were mined for their respective serine protease sequences. Features were extracted for 800 sequences followed by feature selection. We deployed a random forest based classifier that identified thermophilic and non thermophilic serine proteases with an accuracy of 95.71 . Knowledge of thermostability along with amino acid positional shifts can be vital for downstream protein engineering techniques. Thus, to emphasize the real time application of the enzyme specific classification model, a web platform has been designed. Combining the sequence data and the classification model, this prototype can allow users to align their query serine protease sequence against the custom database and identify its thermophilic nature.


T convex T differential fields and their immediate extensions. Let T be a polynomially bounded o minimal theory extending the theory of real closed ordered fields. Let K be a model of T equipped with a T convex valuation ring and a T derivation. If this derivation is continuous with respect to the valuation topology, then we call K a T convex T differential field. We show that every T convex T differential field has an immediate strict T convex T differential field extension which is spherically complete. In some important cases, the assumption of polynomial boundedness can be relaxed to power boundedness.


An augmented Lagrangian method exploiting an active set strategy and second order information. In this paper, we consider nonlinear optimization problems with nonlinear equality constraints and bound constraints on the variables. For the solution of such problems, many augmented Lagrangian methods have been defined in the literature. Here, we propose to modify one of these algorithms, namely ALGENCAN by Andreani et al., in such a way to incorporate second order information into the augmented Lagrangian framework, using an active set strategy. We show that the overall algorithm has the same convergence properties as ALGENCAN and an asymptotic quadratic convergence rate under suitable assumptions. The numerical results confirm that the proposed algorithm is a viable alternative to ALGENCAN with greater robustness.


The q Onsager algebra and its alternating central extension. The q Onsager algebra O q has a presentation involving two generators W 0 , W 1 and two relations, called the q Dolan Grady relations. The alternating central extension mathcal O q has a presentation involving the alternating generators lbrace mathcal W k rbrace k 0 infty , lbrace mathcal W k 1 rbrace k 0 infty , lbrace mathcal G k 1 rbrace k 0 infty , lbrace mathcal tilde G k 1 rbrace k 0 infty and a large number of relations. Let langle mathcal W 0, mathcal W 1 rangle denote the subalgebra of mathcal O q generated by mathcal W 0 , mathcal W 1 . It is known that there exists an algebra isomorphism O q to langle mathcal W 0, mathcal W 1 rangle that sends W 0 mapsto mathcal W 0 and W 1 mapsto mathcal W 1 . It is known that the center mathcal Z of mathcal O q is isomorphic to a polynomial algebra in countably many variables. It is known that the multiplication map langle mathcal W 0, mathcal W 1 rangle otimes mathcal Z to mathcal O q , w otimes z mapsto wz is an isomorphism of algebras. We call this isomorphism the standard tensor product factorization of mathcal O q . In the study of mathcal O q there are two natural points of view we can start with the alternating generators, or we can start with the standard tensor product factorization. It is not obvious how these two points of view are related. The goal of the paper is to describe this relationship. We give seven main results the principal one is an attractive factorization of the generating function for some algebraically independent elements that generate mathcal Z .


Encoding and Decoding with Partitioned Complementary Sequences for Low PAPR OFDM. In this study, we propose partitioned complementary sequences (CSs) where the gaps between the clusters encode information bits to achieve low peak to average power ratio (PAPR) orthogonal frequency division multiplexing (OFDM) symbols. We show that the partitioning rule without losing the feature of being a CS coincides with the non squashing partitions of a positive integer and leads to a symmetric separation of clusters. We analytically derive the number of partitioned CSs for given bandwidth and a minimum distance constraint and obtain the corresponding recursive methods for enumerating the values of separations. We show that partitioning can increase the spectral efficiency (SE) without changing the alphabet of the nonzero elements of the CS, i.e., standard CSs relying on Reed Muller (RM) code. We also develop an encoder for partitioned CSs and a maximum likelihood based recursive decoder for additive white Gaussian noise (AWGN) and fading channels. Our results indicate that the partitioned CSs under a minimum distance constraint can perform similar to the standard CSs in terms of average block error rate (BLER) and provide a higher SE at the expense of a limited signal to noise ratio (SNR) loss.


Modulation property of flexural gravity waves on a water surface covered by a compressed ice sheet. We study the nonlinear modulation property of flexural gravity waves on a water surface covered by a compressed ice sheet in a basin of a constant depth. For weakly nonlinear perturbations, we derive the nonlinear Schr "odinger equation and investigate the conditions when a quasi sinusoidal wave becomes unstable with respect to amplitude modulation. The domains of instability are presented in the planes of governing physical parameters they exhibit complicated patterns. It is shown that under certain conditions the modulational instability can develop from shorter groups and for fewer wave periods than in the situation of deep water gravity waves in the free water. The modulational instability can occur at the conditions shallower than that known for the free water surface kh 1.363, where k is the wavenumber and h is the water depth. Estimates of parameters of modulated waves are given for the typical physical conditions of an ice covered sea.


Planning and Learning Using Adaptive Entropy Tree Search. We present the Adaptive Entropy Tree Search (ANTS) algorithm, a planning method based on the Principle of Maximum Entropy. Importantly, we design ANTS so that it is a practical component of a planning learning loop, outperforming state of the art methods on the Atari benchmark. The key algorithmic novelty is entropy parameterization, which mitigates sensitivity to the temperature parameter a bottleneck of the prior maximum entropy planning methods. To confirm our design choices, we perform a comprehensive suite of ablations in isolation from learning. Moreover, we theoretically show that ANTS enjoys exponential convergence in the softmax bandit setting.


Beyond Capacity The Joint Time Rate Region. The traditional notion of capacity studied in the context of memoryless network communication builds on the concept of block codes and requires that, for sufficiently large blocklength n, all receiver nodes simultaneously decode their required information after n channel uses. In this work, we generalize the traditional capacity region by exploring communication rates achievable when some receivers are required to decode their information before others, at different predetermined times referred here as the "time rate" region. Through a reduction to the standard notion of capacity, we present an inner bound on the time rate region. The time rate region has been previously studied and characterized for the memoryless broadcast channel (with a sole common message) under the name "static broadcasting".


Video rate dual modal forward viewing photoacoustic and fluorescence endo microscopy through a multimode fibre. Multimode fibres are becoming increasingly attractive in optical endoscopy as they promise to enable unparalleled miniaturisation, spatial resolution and cost as compared to conventional fibre bundle based counterpart. However, achieving high speed imaging through a multimode fibre (MMF) based on wavefront shaping has been challenging due to the use of liquid crystal spatial light modulators with low frame rates. In this work, we report the development of a video rate dual modal forward viewing photoacoustic (PA) and fluorescence endo microscopy probe based on a MMF and a high speed digital micromirror device (DMD). Light transmission characteristics through the fibre were characterised with a real valued intensity transmission matrix algorithm, and subsequently, optimal binary patterns were calculated to focus light through the fibre with wavefront shaping. Raster scanning of a tightly focused beam (1.5 mu m diameter) at the distal end of the fibre was performed for imaging. With the DMD running at 10 kHz, the PA imaging speed and spatial resolution of were controlled by varying the scanning step size, ranging from 1 to 25 frames per second (fps) and from 1.7 to 3 mu m, respectively, over a field of view of 50 mu m x 50 mu m. High resolution PA images of carbon fibres, and mouse red blood cells were acquired through a MMF with high image fidelity at unprecedented speed with MMF based PA endoscope. The capability of dual modal PA and fluorescence imaging was demonstrated by imaging phantoms comparing carbon fibres and fluorescent microspheres. We anticipate that with further miniaturisation of the ultrasound detector, this probe could be integrated into a medical needle to guide minimally invasive procedures in several clinical contexts including tumour biopsy and nerve blocks.


A Comparative Evaluation of Predominant Deep Learning Quantified Stock Trading Strategies. This study first reconstructs three deep learning powered stock trading models and their associated strategies that are representative of distinct approaches to the problem and established upon different aspects of the many theories evolved around deep learning. It then seeks to compare the performance of these strategies from different perspectives through trading simulations ran on three scenarios when the benchmarks are kept at historical low points for extended periods of time. The results show that in extremely adverse market climates, investment portfolios managed by deep learning powered algorithms are able to avert accumulated losses by generating return sequences that shift the constantly negative CSI 300 benchmark return upward. Among the three, the LSTM model's strategy yields the best performance when the benchmark sustains continued loss.


An upper bound for the nonsolvable length of a finite group in terms of its shortest law. Every finite group G has a normal series each of whose factors is either a solvable group or a direct product of non abelian simple groups. The minimum number of nonsolvable factors, attained on all possible such series in G , is called the emph nonsolvable length lambda(G) of G . In the present paper, we prove a theorem about permutation representations of groups of fixed nonsolvable length. As a consequence, we show that in a finite group of nonsolvable length at least n , no non trivial word of length at most n (in any number of variables) can be a law. This result is then used to give a bound on lambda(G) in terms of the length of the shortest law of G , thus confirming a conjecture of Larsen. Moreover our Theorem C can be used to give a positive answer, in the case p 2 , to a problem raised by Khukhro and Shumyatsky, concerning the non p solvable length of finite groups.


An Efficient Style Virtual Try on Network for Clothing Business Industry. With the increasing development of garment manufacturing industry, the method of combining neural network with industry to reduce product redundancy has been paid more and more attention.In order to reduce garment redundancy and achieve personalized customization, more researchers have appeared in the field of virtual trying on.They try to transfer the target clothing to the reference figure, and then stylize the clothes to meet user's requirements for fashion.But the biggest problem of virtual try on is that the shape and motion blocking distort the clothes, causing the patterns and texture on the clothes to be impossible to restore. This paper proposed a new stylized virtual try on network, which can not only retain the authenticity of clothing texture and pattern, but also obtain the undifferentiated stylized try on. The network is divided into three sub networks, the first is the user image, the front of the target clothing image, the semantic segmentation image and the posture heat map to generate a more detailed human parsing map. Second, UV position map and dense correspondence are used to map patterns and textures to the deformed silhouettes in real time, so that they can be retained in real time, and the rationality of spatial structure can be guaranteed on the basis of improving the authenticity of images. Third,Stylize and adjust the generated virtual try on image. Through the most subtle changes, users can choose the texture, color and style of clothing to improve the user's experience.


An Improved Bound for the Tree Conjecture in Network Creation Games. We study Nash equilibria in the network creation game of Fabrikant et al. 10 . In this game a vertex can buy an edge to another vertex for a cost of alpha , and the objective of each vertex is to minimize the sum of the costs of the edges it purchases plus the sum of the distances to every other vertex in the resultant network. A long standing conjecture states that if alpha ge n then every Nash equilibrium in the game is a spanning tree. We prove the conjecture holds for any alpha 3n 3 .


Disentangled Sequence Clustering for Human Intention Inference. Equipping robots with the ability to infer human intent is a vital precondition for effective collaboration. Most computational approaches towards this objective derive a probabilistic distribution of "intent" conditioned on the robot's perceived sensory state. However, these approaches typically assume task specific labels of human intent are known a priori. To overcome this constraint, we propose the Disentangled Sequence Clustering Variational Autoencoder (DiSCVAE), a clustering framework capable of learning such a distribution of intent in an unsupervised manner. The DiSCVAE leverages recent advances in unsupervised learning to recover a disentangled latent representation of sequential data, separating time varying local features from time invariant global aspects. Though unlike previous frameworks for disentanglement, the proposed variant also infers a discrete variable to form a latent mixture model and enable clustering of global sequence concepts, e.g. intentions from observed human behaviour. To evaluate the DiSCVAE, we first validate its capacity to discover classes from unlabelled sequences using video datasets of bouncing digits and 2D animations. We then report results from a real world human robot interaction experiment conducted on a robotic wheelchair. Our findings reveal that the inferred discrete variable coincides with human intent and can thus improve assistance in collaborative settings, such as shared control.


Hybrid matheuristics to solve the integrated lot sizing and scheduling problem on parallel machines with sequence dependent and non triangular setup. This paper approaches the integrated lot sizing and scheduling problem (ILSSP), in which non identical machines work in parallel with non triangular sequence dependent setup costs and times, setup carry over and capacity limitation. The aim of the studied ILSSP, here called ILSSP NT on parallel machines, is to determine a production planning and tasks sequencing that meet period demands without delay and in such a way that the total costs of production, machine setup and inventory are minimized. The dearth of literature on the ILSSP NT, despite the increasing amount of applications in the industrial sector, mainly in the food processing industry, motivated us to conduct this study. In this paper, we propose efficient methods to solve the ILSSP NT on parallel machines. The methods virtually consist in the hybridization of the relax and fix and fix and optimize methods with the path relinking and kernel search heuristics. To assess how well the heuristics solve the ILSSP NT on parallel machines, we compared their results with those of the CPLEX solver with a fixed CPU time limit. The proposed matheuristics significantly outperformed CPLEX in most of the tested instances.


Data driven deep learning algorithms for time varying infection rates of COVID 19 and mitigation measures. Epidemiology models with constant parameters may not capture the infection patterns in the presence of pharmaceutical and non pharmaceutical mitigation measures during a pandemic, since infectiousness is a function of time. In this paper, Epidemiology Informed Neural Network (EINN) algorithms are introduced to discover time varying infection rates for the COVID 19 pandemic. Since there are asymptomatic infectives, mostly unreported, EINN learns the probability that an infective individual is asymptomatic. Using cumulative and daily reported cases of infectives, we simulate the impact of non pharmaceutical mitigation measures such as early detection of infectives, contact tracing, and social distancing on the basic reproduction number. We demonstrate the effectiveness of vaccination, a pharmaceutical mitigation measure, together with non pharmaceutical mitigation measures on the daily reported infectives. The EINN algorithms discover time varying infection and recovery rates. The Mean Squared Error is used to demonstrate the accuracy of the proposed EINN algorithms. Simulations are presented for Italy, South Korea, United Kingdom, and the United States.


Influence of Roles in Decision Making during OSS Development A Study of Python. Governance has been highlighted as a key factor in the success of an Open Source Software (OSS) project. It is generally seen that in a mixed meritocracy and autocracy governance model, the decision making (DM) responsibility regarding what features are included in the OSS is shared among members from select roles prominently the project leader. However, less examination has been made whether members from these roles are also prominent in DM discussions and how decisions are made, to show they play an integral role in the success of the project. We believe that to establish their influence, it is necessary to examine not only discussions of proposals in which the project leader makes the decisions, but also those where others make the decisions. Therefore, in this study, we examine the prominence of members performing different roles in (i) making decisions, (ii) performing certain social roles in DM discussions (e.g., discussion starters), (iii) contributing to the OSS development social network through DM discussions, and (iv) how decisions are made under both scenarios. We examine these aspects in the evolution of the well known Python project. We carried out a data driven longitudinal study of their email communication spanning 20 years, comprising about 1.5 million emails. These emails contain decisions for 466 Python Enhancement Proposals (PEPs) that document the language's evolution. Our findings make the influence of different roles transparent to future (new) members, other stakeholders, and more broadly, to the OSS research community.


Multimodal End to End Sparse Model for Emotion Recognition. Existing works on multimodal affective computing tasks, such as emotion recognition, generally adopt a two phase pipeline, first extracting feature representations for each single modality with hand crafted algorithms and then performing end to end learning with the extracted features. However, the extracted features are fixed and cannot be further fine tuned on different target tasks, and manually finding feature extraction algorithms does not generalize or scale well to different tasks, which can lead to sub optimal performance. In this paper, we develop a fully end to end model that connects the two phases and optimizes them jointly. In addition, we restructure the current datasets to enable the fully end to end training. Furthermore, to reduce the computational overhead brought by the end to end model, we introduce a sparse cross modal attention mechanism for the feature extraction. Experimental results show that our fully end to end model significantly surpasses the current state of the art models based on the two phase pipeline. Moreover, by adding the sparse cross modal attention, our model can maintain performance with around half the computation in the feature extraction part.


Private Recommender Systems How Can Users Build Their Own Fair Recommender Systems without Log Data?. Fairness is a crucial property in recommender systems. Although some online services have adopted fairness aware systems recently, many other services have not adopted them yet. In this work, we propose methods to enable the users to build their own fair recommender systems. Our methods can generate fair recommendations even when the service does not (or cannot) provide fair recommender systems. The key challenge is that a user does not have access to the log data of other users or the latent representations of items. This restriction prohibits us from adopting existing methods designed for service providers. The main idea is that a user has access to unfair recommendations shown by the service provider. Our methods leverage the outputs of an unfair recommender system to construct a new fair recommender system. We empirically validate that our proposed method improves fairness substantially without harming much performance of the original unfair system.


DP XGBoost Private Machine Learning at Scale. The big data revolution announced ten years ago does not seem to have fully happened at the expected scale. One of the main obstacle to this, has been the lack of data circulation. And one of the many reasons people and organizations did not share as much as expected is the privacy risk associated with data sharing operations. There has been many works on practical systems to compute statistical queries with Differential Privacy (DP). There have also been practical implementations of systems to train Neural Networks with DP, but relatively little efforts have been dedicated to designing scalable classical Machine Learning (ML) models providing DP guarantees. In this work we describe and implement a DP fork of a battle tested ML model XGBoost. Our approach beats by a large margin previous attempts at the task, in terms of accuracy achieved for a given privacy budget. It is also the only DP implementation of boosted trees that scales to big data and can run in distributed environments such as Kubernetes, Dask or Apache Spark.


General fractional integrals and derivatives of arbitrary order. In this paper, we introduce the general fractional integrals and derivatives of arbitrary order and study some of their basic properties and particular cases. First, a suitable generalization of the Sonine condition is presented and some important classes of the kernels that satisfy this condition are introduced. Whereas the kernels of the general fractional derivatives with these kernels possess the integrable singularities at the point zero, the kernels of the general fractional integrals can be depending on their order both singular and continuous at the origin. For the general fractional integrals and derivatives of arbitrary order with the kernels introduced in this paper, two fundamental theorems of fractional calculus are formulated and proved.


Hypergraphs with minimum positive uniform Tur 'an density. Reiher, R "odl and Schacht J. London Math. Soc. 97 (2018), 77 97 showed that the uniform Tur 'an density of every 3 uniform hypergraph is either 0 or at least 1 27 , and asked whether there exist 3 uniform hypergraphs with uniform Tur 'an density equal or arbitrarily close to 1 27 . We construct 3 uniform hypergraphs with uniform Tur 'an density equal to 1 27 .


Knowledge Infused Policy Gradients with Upper Confidence Bound for Relational Bandits. Contextual Bandits find important use cases in various real life scenarios such as online advertising, recommendation systems, healthcare, etc. However, most of the algorithms use flat feature vectors to represent context whereas, in the real world, there is a varying number of objects and relations among them to model in the context. For example, in a music recommendation system, the user context contains what music they listen to, which artists create this music, the artist albums, etc. Adding richer relational context representations also introduces a much larger context space making exploration exploitation harder. To improve the efficiency of exploration exploitation knowledge about the context can be infused to guide the exploration exploitation strategy. Relational context representations allow a natural way for humans to specify knowledge owing to their descriptive nature. We propose an adaptation of Knowledge Infused Policy Gradients to the Contextual Bandit setting and a novel Knowledge Infused Policy Gradients Upper Confidence Bound algorithm and perform an experimental analysis of a simulated music recommendation dataset and various real life datasets where expert knowledge can drastically reduce the total regret and where it cannot.


Learning Multi agent Action Coordination via Electing First move Agent. Learning to coordinate actions among agents is essential in complicated multi agent systems. Prior works are constrained mainly by the assumption that all agents act simultaneously, and asynchronous action coordination between agents is rarely considered. This paper introduces a bi level multi agent decision hierarchy for coordinated behavior planning. We propose a novel election mechanism in which we adopt a graph convolutional network to model the interaction among agents and elect a first move agent for asynchronous guidance. We also propose a dynamically weighted mixing network to effectively reduce the misestimation of the value function during training. This work is the first to explicitly model the asynchronous multi agent action coordination, and this explicitness enables to choose the optimal first move agent. The results on Cooperative Navigation and Google Football demonstrate that the proposed algorithm can achieve superior performance in cooperative environments. Our code is available at url https github.com Amanda 1997 EFA DWM .


Consistency and prior falsification of training data in seismic deep learning Application to offshore deltaic reservoir characterization. Deep learning applications of seismic reservoir characterization often require generation of synthetic data to augment available sparse labeled data. An approach for generating synthetic training data consists of specifying probability distributions modeling prior geologic uncertainty on reservoir properties and forward modeling the seismic data. A prior falsification approach is critical to establish the consistency of the synthetic training data distribution with real seismic data. With the help of a real case study of facies classification with convolutional neural networks (CNNs) from an offshore deltaic reservoir, we highlight several practical nuances associated with training deep learning models on synthetic seismic data. We highlight the issue of overfitting of CNNs to the synthetic training data distribution and propose regularization strategies to address it. We demonstrate the efficacy of our proposed strategies by training the CNN on synthetic data and making robust predictions with real 3D partial stack seismic data.


physics.bio-ph physics.data-an q-bio.QM q-bio.SC

Unraveling Single Particle Trajectories Confined in Tubular Networks. The analysis of single particle trajectories plays an important role in elucidating dynamics within complex environments such as those found in living cells. However, the characterization of intracellular particle motion is often confounded by confinement of the particles within non trivial subcellular geometries. Here, we focus specifically on the case of particles undergoing Brownian motion within a tubular network, as found in some cellular organelles. An unraveling algorithm is developed to uncouple particle motion from the confining network structure, allowing for an accurate extraction of the diffusion coefficient, as well as differentiating between Brownian and fractional Brownian dynamics. We validate the algorithm with simulated trajectories and then highlight its application to an example system analyzing the motion of membrane proteins confined in the tubules of the peripheral endoplasmic reticulum in mammalian cells. We show that these proteins undergo diffusive motion with a well characterized diffusivity. Our algorithm provides a generally applicable approach for disentangling geometric morphology and particle dynamics in networked architectures.


Learning Fair Classifiers with Partially Annotated Group Labels. Recently, fairness aware learning have become increasingly crucial, but most of those methods operate by assuming the availability of fully annotated demographic group labels. We emphasize that such assumption is unrealistic for real world applications since group label annotations are expensive and can conflict with privacy issues. In this paper, we consider a more practical scenario, dubbed as Algorithmic Group Fairness with the Partially annotated Group labels (Fair PG). We observe that the existing methods to achieve group fairness perform even worse than the vanilla training, which simply uses full data only with target labels, under Fair PG. To address this problem, we propose a simple Confidence based Group Label assignment (CGL) strategy that is readily applicable to any fairness aware learning method. CGL utilizes an auxiliary group classifier to assign pseudo group labels, where random labels are assigned to low confident samples. We first theoretically show that our method design is better than the vanilla pseudo labeling strategy in terms of fairness criteria. Then, we empirically show on several benchmark datasets that by combining CGL and the state of the art fairness aware in processing methods, the target accuracies and the fairness metrics can be jointly improved compared to the baselines. Furthermore, we convincingly show that CGL enables to naturally augment the given group labeled dataset with external target label only datasets so that both accuracy and fairness can be improved. Code is available at https github.com naver ai cgl fairness.


ConQuer 92 The revised report on the conceptual query language LISA D. In this report the conceptual query language ConQuer 92 is introduced. This query language serves as the backbone of InfoAssistant's query facilities. Furthermore, this language can also be used for the specification of derivation rules (e.g. subtype defining rules) and textual constraints in InfoModeler. This report is solely concerned with a formal definition, and the explanation thereof, of ConQuer 92. The implementation of ConQuer 92 in SQL 92 will be treated in a separate report.


Learn Goal Conditioned Policy with Intrinsic Motivation for Deep Reinforcement Learning. It is of significance for an agent to learn a widely applicable and general purpose policy that can achieve diverse goals including images and text descriptions. Considering such perceptually specific goals, the frontier of deep reinforcement learning research is to learn a goal conditioned policy without hand crafted rewards. To learn this kind of policy, recent works usually take as the reward the non parametric distance to a given goal in an explicit embedding space. From a different viewpoint, we propose a novel unsupervised learning approach named goal conditioned policy with intrinsic motivation (GPIM), which jointly learns both an abstract level policy and a goal conditioned policy. The abstract level policy is conditioned on a latent variable to optimize a discriminator and discovers diverse states that are further rendered into perceptually specific goals for the goal conditioned policy. The learned discriminator serves as an intrinsic reward function for the goal conditioned policy to imitate the trajectory induced by the abstract level policy. Experiments on various robotic tasks demonstrate the effectiveness and efficiency of our proposed GPIM method which substantially outperforms prior techniques.


Exploring Visual Engagement Signals for Representation Learning. Visual engagement in social media platforms comprises interactions with photo posts including comments, shares, and likes. In this paper, we leverage such visual engagement clues as supervisory signals for representation learning. However, learning from engagement signals is non trivial as it is not clear how to bridge the gap between low level visual information and high level social interactions. We present VisE, a weakly supervised learning approach, which maps social images to pseudo labels derived by clustered engagement signals. We then study how models trained in this way benefit subjective downstream computer vision tasks such as emotion recognition or political bias detection. Through extensive studies, we empirically demonstrate the effectiveness of VisE across a diverse set of classification tasks beyond the scope of conventional recognition.


Ergodicity of Controlled Stochastic Nonlinear Systems under Information Constraints Refined Bounds via Splitting. This paper considers the problem of stabilizing a discrete time non linear stochastic system over a finite capacity noiseless channel. Our focus is on systems which decompose into a stable and unstable component, and the stability notion considered is asymptotic ergodicity of the mathbb R N valued state process. We establish a necessary lower bound on channel capacity for the existence of a coding and control policy which renders the closed loop system stochastically stable. In the literature, it has been established that under technical assumptions, the channel capacity must not be smaller than the logarithm of the determinant of the system linearization, averaged over the noise and ergodic state measures. In this paper, we establish that for systems with a stable component, it suffices to consider only the unstable dimensions, providing a refinement on the general channel capacity bound for a large class of systems. The result is established using the notion of stabilization entropy, a notion adapted from invariance entropy, used in the study of noise free systems under information constraints.


NullaNet Tiny Ultra low latency DNN Inference Through Fixed function Combinational Logic. While there is a large body of research on efficient processing of deep neural networks (DNNs), ultra low latency realization of these models for applications with stringent, sub microsecond latency requirements continues to be an unresolved, challenging problem. Field programmable gate array (FPGA) based DNN accelerators are gaining traction as a serious contender to replace graphics processing unit central processing unit based platforms considering their performance, flexibility, and energy efficiency. This paper presents NullaNet Tiny, an across the stack design and optimization framework for constructing resource and energy efficient, ultra low latency FPGA based neural network accelerators. The key idea is to replace expensive operations required to compute various filter neuron functions in a DNN with Boolean logic expressions that are mapped to the native look up tables (LUTs) of the FPGA device (examples of such operations are multiply and accumulate and batch normalization). At about the same level of classification accuracy, compared to Xilinx's LogicNets, our design achieves 2.36 times lower latency and 24.42 times lower LUT utilization.


Approximate Normalization and Eager Equality Checking for Gradual Inductive Families. Harnessing the power of dependently typed languages can be difficult. Programmers must manually construct proofs to produce well typed programs, which is not an easy task. In particular, migrating code to these languages is challenging. Gradual typing can make dependently typed languages easier to use by mixing static and dynamic checking in a principled way. With gradual types, programmers can incrementally migrate code to a dependently typed language. However, adding gradual types to dependent types creates a new challenge mixing decidable type checking and incremental migration in a full featured language is a precarious balance. Programmers expect type checking to terminate, but dependent type checkers evaluate terms at compile time, which is problematic because gradual types can introduce non termination into an otherwise terminating language. Steps taken to mitigate this non termination must not jeopardize the smooth transitions between dynamic and static. We present a gradual dependently typed language that supports inductive type families, has decidable type checking, and provably supports smooth migration between static and dynamic, as codified by the refined criteria for gradual typing proposed by Siek et al. (2015). Like Eremondi et al. (2019), we use approximate normalization for terminating compile time evaluation. Unlike Eremondi et al., our normalization does not require comparison of variables, allowing us to show termination with a syntactic model that accommodates inductive types. Moreover, we design a novel a technique for tracking constraints on type indices, so that dynamic constraint violations signal run time errors eagerly. To facilitate these checks, we define an algebraic notion of gradual precision, axiomatizing certain semantic properties of gradual terms.


A learning based projection method for model order reduction of transport problems. The Kolmogorov n width of the solution manifolds of transport dominated problems can decay slowly. As a result, it can be challenging to design efficient and accurate reduced order models (ROMs) for such problems. To address this issue, we propose a new learning based projection method to construct nonlinear adaptive ROMs for transport problems. The construction follows the offline online decomposition. In the offline stage, we train a neural network to construct adaptive reduced basis dependent on time and model parameters. In the online stage, we project the solution to the learned reduced manifold. Inheriting the merits from both deep learning and the projection method, the proposed method is more efficient than the conventional linear projection based methods, and may reduce the generalization error of a solely learning based ROM. Unlike some learning based projection methods, the proposed method does not need to take derivatives of the neural network in the online stage.


Green fields. We introduce em Green fields , as commutative Green biset functors with no non trivial ideals. We state some of their properties and give examples of known Green biset functors which are Green fields. Among the properties, we prove some criterions ensuring that a Green field is semisimple. Finally, we describe a type of Green field for which its category of modules is equivalent to a category of vector spaces over a field.


FoV Privacy aware VR Streaming. Proactive tile based virtual reality (VR) video streaming can use the trace of FoV and eye movement to predict future requested tiles, then renders and delivers the predicted tiles before playback. The quality of experience (QoE) depends on the combined effect of tile prediction and consumed resources. Recently, it has been found that with the FoV and eye movement data collected for a user, one can infer the identity and preference of the user. Existing works investigate the privacy protection for eye movement, but never address how to protect the privacy in terms of FoV and how the privacy protection affects the QoE. In this paper, we strive to characterize and satisfy the FoV privacy requirement. We consider "trading resources for privacy". We first add camouflaged tile requests around the real FoV and define spatial degree of privacy (SDoP) as a normalized number of camouflaged tile requests. By consuming more resources to ensure SDoP, the real FoVs can be hidden. Then, we proceed to analyze the impacts of SDoP on the QoE by jointly optimizing the durations for prediction, computing, and transmission that maximizes the QoE given arbitrary predictor, configured resources, and SDoP. We find that a larger SDoP requires more resources but degrades the performance of tile prediction. Simulation with state of the art predictors on a real dataset verifies the analysis and shows that a user requiring a larger SDoP can be served with better QoE.


Estimating the p adic valuation of the resultant. Let f and g be two monic polynomials with integer coefficients and nonzero resultant r . Assume that v p(f(n)) ge s 1 and v p(g(n)) ge s 2 hold for all integers n for some s 1, s 2 fixed non negative integers. Let S denote the maximum of v p(gcd(f(n),g(n))) over all integers n . In this paper, we establish multiple lower bound for v p(r) . More specifically, we show that v p(r) ge S max s 1,s 2 ps 1s 2 frac p 1 p p k , where k lfloor log p((p 1) max s 1,s 2 1) rfloor 1 .


Complex symmetry of Toeplitz operators. We introduce a new class of conjugations and characterize complex symmetric Toeplitz operators on the Hardy space with respect to those conjugations. Also, we prove that complex symmetricity and uet property are the same for a certain class of Toeplitz operators. We also discuss the analytic symmetricity for Toeplitz operators. Our results extend several known results by providing unified ways of treating them.


Incorporating dependence on ice thickness in empirical parameterizations of wave dissipation by sea ice. This study is part of an effort to improve the Navy's ability to forecast wind generated ocean waves in ice infested regions, and here we are attempting to further this goal by improving prediction of dissipation of wave energy by sea ice. Rogers et al. (2021) presented new estimates of frequency dependent dissipation of wave energy by sea ice, based on model data inversion, and studied the correlation with various other parameters, such as ice thickness and sea state variables. Here, we use that dataset to propose a new dissipation parameterization which explicitly incorporates the dependence on the ice thickness, in addition to the wave frequency. The goal is to determine whether a parameterization dependent on wave frequency and ice thickness can be more accurate than one dependent only on wave frequency. Due to the dominant impact of frequency and confounding difficulties of field measurements, this is not a foregone conclusion. A parameterization is developed using the non dimensionalization approach proposed by Yu et al. (2019). We find that the non dimensionalization does result in significant scale collapse of the data, and inclusion of ice thickness does improve accuracy, most evidenced by reduced scatter when applied to the same dataset. However, evaluations against independent datasets are mixed. Possible reasons for this are discussed.


Controlled transfer of transverse optical angular momentum to optically trapped birefringent particles. We report on the observation and measurement of the transfer of transverse angular momentum to birefringent particles several wavelengths in size. A trapped birefringent particle is much larger than the nano particles systems for which transverse angular momentum was previously investigated. The larger birefringent particle interacts more strongly with both the trapping beam and fluid surrounding it. This technique could be used to transfer transverse angular momentum for studies of diverse micro systems. Thus, it can be used for investigation of the dynamics of complex fluids in 3D as well as for shear on cell mono layers. The trapping of such a particle with highly focused light is complex and can lead to the emergence of effects such as spin orbit coupling. We estimate the transfer of spin angular momentum using Stokes measurements. We outline the physics behind the construction of the beam used to control the particles, perform quantitative measurement of transverse spin angular momentum transfer, as well as demonstrate the generation of fluid flow around multiple rotation axes.


ZeroCap Zero Shot Image to Text Generation for Visual Semantic Arithmetic. Recent text to image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matching and subsequent zero shot tasks, they are not capable of generating caption given an image. In this work, we repurpose such models to generate a descriptive text given an image at inference time, without any further training or tuning steps. This is done by combining the visual semantic model with a large language model, benefiting from the knowledge in both web scale models. The resulting captions are much less restrictive than those obtained by supervised captioning methods. Moreover, as a zero shot learning method, it is extremely flexible and we demonstrate its ability to perform image arithmetic in which the inputs can be either images or text, and the output is a sentence. This enables novel high level vision capabilities such as comparing two images or solving visual analogy tests. Our code is available at https github.com YoadTew zero shot image to text.


Exploiting Curriculum Learning in Unsupervised Neural Machine Translation. Back translation (BT) has become one of the de facto components in unsupervised neural machine translation (UNMT), and it explicitly makes UNMT have translation ability. However, all the pseudo bi texts generated by BT are treated equally as clean data during optimization without considering the quality diversity, leading to slow convergence and limited translation performance. To address this problem, we propose a curriculum learning method to gradually utilize pseudo bi texts based on their quality from multiple granularities. Specifically, we first apply cross lingual word embedding to calculate the potential translation difficulty (quality) for the monolingual sentences. Then, the sentences are fed into UNMT from easy to hard batch by batch. Furthermore, considering the quality of sentences tokens in a particular batch are also diverse, we further adopt the model itself to calculate the fine grained quality scores, which are served as learning factors to balance the contributions of different parts when computing loss and encourage the UNMT model to focus on pseudo data with higher quality. Experimental results on WMT 14 En Fr, WMT 16 En De, WMT 16 En Ro, and LDC En Zh translation tasks demonstrate that the proposed method achieves consistent improvements with faster convergence speed.


Technical Report Insider Resistant Context Based Pairing for Multimodality Sleep Apnea Test. The increasingly sophisticated at home screening systems for obstructive sleep apnea (OSA), integrated with both contactless and contact based sensing modalities, bring convenience and reliability to remote chronic disease management. However, the device pairing processes between system components are vulnerable to wireless exploitation from a non compliant user wishing to manipulate the test results. This work presents SIENNA, an insider resistant context based pairing protocol. SIENNA leverages JADE ICA to uniquely identify a user's respiration pattern within a multi person environment and fuzzy commitment for automatic device pairing, while using friendly jamming technique to prevents an insider with knowledge of respiration patterns from acquiring the pairing key. Our analysis and test results show that SIENNA can achieve reliable ( 90 success rate) device pairing under a noisy environment and is robust against the attacker with full knowledge of the context information.


On S ramified T split Iwasawa modules. We correct the faulty formulas given in a previous article and we compute the defect group for the Iwasawa lambda invariants attached to the S ramified T decomposed a belian pro ell extensions on the Z ell cyclotomic extensionof a number field. As a consequence, we extend the results of Itoh, Mizusawa and Ozaki on tamely ramified Iwasawa modules for the cyclotomic Z ell extension of abelian fields.


Equations of the Cayley Surface. In this note we study the integer solutions of Cayley's cubic equation. We find infinite families of solutions built from recurrence relations. We use these solutions to solve certain general Pell equations. We also show the similarities and differences to Markov numbers. In particular we introduce new formulae for the solutions to Cayley's cubic equation in analogy with Markov numbers and discuss their distinctions.


Skeleton Merger an Unsupervised Aligned Keypoint Detector. Detecting aligned 3D keypoints is essential under many scenarios such as object tracking, shape retrieval and robotics. However, it is generally hard to prepare a high quality dataset for all types of objects due to the ambiguity of keypoint itself. Meanwhile, current unsupervised detectors are unable to generate aligned keypoints with good coverage. In this paper, we propose an unsupervised aligned keypoint detector, Skeleton Merger, which utilizes skeletons to reconstruct objects. It is based on an Autoencoder architecture. The encoder proposes keypoints and predicts activation strengths of edges between keypoints. The decoder performs uniform sampling on the skeleton and refines it into small point clouds with pointwise offsets. Then the activation strengths are applied and the sub clouds are merged. Composite Chamfer Distance (CCD) is proposed as a distance between the input point cloud and the reconstruction composed of sub clouds masked by activation strengths. We demonstrate that Skeleton Merger is capable of detecting semantically rich salient keypoints with good alignment, and shows comparable performance to supervised methods on the KeypointNet dataset. It is also shown that the detector is robust to noise and subsampling. Our code is available at https github.com eliphatfs SkeletonMerger.


Recursive sequences attached to modular representations of finite groups. The core of a finite dimensional modular representation M of a finite group G is its largest non projective summand. We prove that the dimensions of the cores of M otimes n have algebraic Hilbert series when M is Omega algebraic, in the sense that the non projective summands of M otimes n fall into finitely many orbits under the action of the syzygy operator Omega . Similarly, we prove that these dimension sequences are eventually linearly recursive when M is what we term Omega algebraic. This partially answers a conjecture by Benson and Symonds. Along the way, we also prove a number of auxiliary permanence results for linear recurrence under operations on multi variable sequences.


Congestion control in high speed networks using the probabilistic estimation approach. Nowadays, the bulk of Internet traffic uses TCP protocol for reliable transmission. But the standard TCP's performance is very poor in High Speed Networks (HSN) and hence the core gigabytes links are usually underutilization. This problem has roots in conservative nature of TCP, especially in its Additive Increase Multiplicative Decrease (AIMD) phase. In other words, since TCP can't figure out precisely the congestion status of the network, it follows a conservative strategy to keep the network from overwhelming. We believe that precisely congestion estimation in the network can solve this problem by avoiding unnecessary conservation. To this end, this paper proposes an algorithm which considers packet loss and delay information jointly and employs a probabilistic approach to accurately estimation of congestion status in the network. To examine the proposed scheme performance, extensive simulations have been performed in the NS 2 environment. Simulation results reveal that the proposed algorithm has better performance than existing algorithms in terms of bottleneck utilization, stability, throughput and fairness.


Diagonal Sums of Doubly Stochastic Matrices. Let Omega n denote the class of n times n doubly stochastic matrices (each such matrix is entrywise nonnegative and every row and column sum is 1). We study the diagonals of matrices in Omega n . The main question is which A in Omega n are such that the diagonals in A that avoid the zeros of A all have the same sum of their entries. We give a characterization of such matrices, and establish several classes of patterns of such matrices.


Fast Monocular Hand Pose Estimation on Embedded Systems. Hand pose estimation is a fundamental task in many human robot interaction related applications. However, previous approaches suffer from unsatisfying hand landmark predictions in real world scenes and high computation burden. This paper proposes a fast and accurate framework for hand pose estimation, dubbed as "FastHand". Using a lightweight encoder decoder network architecture, FastHand fulfills the requirements of practical applications running on embedded devices. The encoder consists of deep layers with a small number of parameters, while the decoder makes use of spatial location information to obtain more accurate results. The evaluation took place on two publicly available datasets demonstrating the improved performance of the proposed pipeline compared to other state of the art approaches. FastHand offers high accuracy scores while reaching a speed of 25 frames per second on an NVIDIA Jetson TX2 graphics processing unit.


Laplace and bi Laplace equations for directed networks and Markov chains. The networks of this primarily (but not exclusively) expository compendium are strongly connected, finite directed graphs X , where each oriented edge (x,y) is equipped with a positive weight (conductance) a(x,y) . We are not assuming symmetry of this function, and in general we do not require that along with (x,y) , also (y,x) is an edge. The weights give rise to a difference operator, the normalised version of which we consider as our Laplace operator. It is associated with a Markov chain with state space X . A non empty subset of X is designated as the boundary. We provide a systematic exposition of the different types of Laplace equations, starting with the Poisson equation, Dirichlet problem and Neumann problem. For the latter, we discuss the definition of outer normal derivatives. We then pass to Laplace equations involving potentials, thereby also addressing the Robin boundary problem. Next, we study the bi Laplacian and associated equations the iterated Poisson equation, the bi Laplace Neumann and Dirichlet problems, and the "plate equation". It turns out that the bi Laplace Dirichlet to Neumann map is of non trivial interest. The exposition concludes with two detailed examples.


Explicit decay rate for the Gini index in the repeated averaging model. We investigate the repeated averaging model for money exchanges two agents picked uniformly at random share half of their wealth to each other. It is intuitively convincing that a Dirac distribution of wealth (centered at the initial average wealth) will be the long time equilibrium for this dynamics. In other words, the Gini index should converge to zero. To better understand this dynamics, we investigate its limit as the number of agents goes to infinity by proving the so called propagation of chaos, which links the stochastic agent based dynamics to a (limiting) nonlinear partial differential equation (PDE). This deterministic description has a flavor of the classical Boltzmann equation arising from statistical mechanics of dilute gases. We prove its convergence toward its Dirac equilibrium distribution by showing that the associated Gini index of the wealth distribution converges to zero with an explicit rate.


Circumferential Crack Modeling of Thin Cylindrical Shells in Modal Deformation. An innovative technique, called conversion, is introduced to model circumferential cracks in thin cylindrical shells. The semi analytical finite element method is applied to investigate the modal deformation of the cylinder. An element including the crack is divided into three sub elements with four nodes in which the stiffness matrix is enriched. The crack characteristics are included in the finite element method relations through conversion matrices and a rotational spring corresponding to the crack. Conversion matrices obtained by applying continuity conditions at the crack tip are used to transform displacements of the middle nodes to those of the main nodes. Moreover, another technique, called spring set, is represented based on a set of springs to model the crack as a separated element. Components of the stiffness matrix related to the separated element are incorporated while the geometric boundary conditions at the crack tip are satisfied. The effects of the circumferential mode number, the crack depth and the length of the cylinder on the critical buckling load are investigated. Experimental tests, ABAQUS modeling and results from literature are used to verify and validate the results and derived relations. In addition, the crack effect on the natural frequency is examined using the vibration analysis based on the conversion technique.


Testing macroecological theories in cryptocurrency market neutral models can not describe diversity patterns and their variation. We develop an analysis of the cryptocurrency market borrowing methods and concepts from ecology. This approach makes it possible to identify specific diversity patterns and their variation, in close analogy with ecological systems, and to characterize the cryptocurrency market in an effective way. At the same time, it shows how non biological systems can have an important role in contrasting different ecological theories and in testing the use of neutral models. The study of the cryptocurrencies abundance distribution and the evolution of the community structure strongly indicates that these statistical patterns are not consistent with neutrality. In particular, the necessity to increase the temporal change in community composition when the number of cryptocurrencies grows, suggests that their interactions are not necessarily weak. The analysis of the intraspecific and interspecific interdependency supports this fact and demonstrates the presence of a market sector influenced by mutualistic relations. These latest findings challenge the hypothesis of weakly interacting symmetric species, the postulate at the heart of neutral models.


Chromatographic motion of substances involved in sequential first order reactions. Kinetics of sequential first order reactions occurring in a chromatographic medium is developed. A model for motion of substances of a chain 1 2 3 in an infinite chromatographic column is worked out, and a mathematical procedure and graphical method for obtaining the substance concentration as a function of reaction time and position in the column is proposed. Influence of different factors of chromatographic separation on formation of substance concentration profile is considered. Practical implementation of developed approach is demonstrated by the example of radioactive chain Ac 225 Fr 221 Bi 213 used for modelling a radionuclidic Ac 225 Bi 213 generator producing Bi 213 via continuous separation and decay of intermediate Fr 221.


Solver based Gradual Type Migration. Gradually typed languages allow programmers to mix statically and dynamically typed code, enabling them to incrementally reap the benefits of static typing as they add type annotations to their code. However, this type migration process is typically a manual effort with limited tool support. This paper examines the problem of emph automated type migration given a dynamic program, infer additional or improved type annotations. Existing type migration algorithms prioritize different goals, such as maximizing type precision, maintaining compatibility with unmigrated code, and preserving the semantics of the original program. We argue that the type migration problem involves fundamental compromises optimizing for a single goal often comes at the expense of others. Ideally, a type migration tool would flexibly accommodate a range of user priorities. We present TypeWhich, a new approach to automated type migration for the gradually typed lambda calculus with some extensions. Unlike prior work, which relies on custom solvers, TypeWhich produces constraints for an off the shelf MaxSMT solver. This allows us to easily express objectives, such as minimizing the number of necessary syntactic coercions, and constraining the type of the migration to be compatible with unmigrated code. We present the first comprehensive evaluation of GTLC type migration algorithms, and compare TypeWhich to four other tools from the literature. Our evaluation uses prior benchmarks, and a new set of challenge problems.'' Moreover, we design a new evaluation methodology that highlights the subtleties of gradual type migration. In addition, we apply TypeWhich to a suite of benchmarks for Grift, a programming language based on the GTLC. TypeWhich is able to reconstruct all human written annotations on all but one program.