Self supervised Learning of 3D Object Understanding by Data Association and Landmark Estimation for Image Sequence. In this paper, we propose a self supervised learningmethod for multi object pose estimation. 3D object under standing from 2D image is a challenging task that infers ad ditional dimension from reduced dimensional information.In particular, the estimation of the 3D localization or orien tation of an object requires precise reasoning, unlike othersimple clustering tasks such as object classification. There fore, the scale of the training dataset becomes more cru cial. However, it is challenging to obtain large amount of3D dataset since achieving 3D annotation is expensive andtime consuming. If the scale of the training dataset can beincreased by involving the image sequence obtained fromsimple navigation, it is possible to overcome the scale lim itation of the dataset and to have efficient adaptation tothe new environment. However, when the self annotation isconducted on single image by the network itself, trainingperformance of the network is bounded to the self perfor mance. Therefore, we propose a strategy to exploit multipleobservations of the object in the image sequence in orderto surpass the self performance first, the landmarks for theglobal object map are estimated through network predic tion and data association, and the corrected annotation fora single frame is obtained. Then, network fine tuning is con ducted including the dataset obtained by self annotation,thereby exceeding the performance boundary of the networkitself. The proposed method was evaluated on the KITTIdriving scene dataset, and we demonstrate the performanceimprovement in the pose estimation of multi object in 3D space.


A log linear (2 5 6) approximation algorithm for parallel machine scheduling with a single orthogonal resource. As the gap between compute and I O performance tends to grow, modern High Performance Computing (HPC) architectures include a new resource type an intermediate persistent fast memory layer, called burst buffers. This is just one of many kinds of renewable resources which are orthogonal to the processors themselves, such as network bandwidth or software licenses. Ignoring orthogonal resources while making scheduling decisions just for processors may lead to unplanned delays of jobs of which resource requirements cannot be immediately satisfied. We focus on a classic problem of makespan minimization for parallel machine scheduling of independent sequential jobs with additional requirements on the amount of a single renewable orthogonal resource. We present an easily implementable log linear algorithm that we prove is 2 frac56 approximation. In simulation experiments, we compare our algorithm to standard greedy list scheduling heuristics and show that, compared to LPT, resource based algorithms generate significantly shorter schedules.


Practical Evaluation of Out of Distribution Detection Methods for Image Classification. We reconsider the evaluation of OOD detection methods for image recognition. Although many studies have been conducted so far to build better OOD detection methods, most of them follow Hendrycks and Gimpel's work for the method of experimental evaluation. While the unified evaluation method is necessary for a fair comparison, there is a question of if its choice of tasks and datasets reflect real world applications and if the evaluation results can generalize to other OOD detection application scenarios. In this paper, we experimentally evaluate the performance of representative OOD detection methods for three scenarios, i.e., irrelevant input detection, novel class detection, and domain shift detection, on various datasets and classification tasks. The results show that differences in scenarios and datasets alter the relative performance among the methods. Our results can also be used as a guide for practitioners for the selection of OOD detection methods.


Dilations of Linear Maps on Vector Spaces. We continue the study dilation of linear maps on vector spaces introduced by Bhat, De, and Rakshit. This notion is a variant of vector space dilation introduced by Han, Larson, Liu, and Liu. We derive vector space versions of Wold decomposition, Halmos dilation, N dilation, inter twining lifting theorem and a variant of Ando dilation. It is noted further that unlike a kind of uniqueness of Halmos dilation of strict contractions on Hilbert spaces, vector space version of Halmos dilation can not be characterized.


Asymmetric Modality Translation For Face Presentation Attack Detection. Face presentation attack detection (PAD) is an essential measure to protect face recognition systems from being spoofed by malicious users and has attracted great attention from both academia and industry. Although most of the existing methods can achieve desired performance to some extent, the generalization issue of face presentation attack detection under cross domain settings (e.g., the setting of unseen attacks and varying illumination) remains to be solved. In this paper, we propose a novel framework based on asymmetric modality translation for face presentation attack detection in bi modality scenarios. Under the framework, we establish connections between two modality images of genuine faces. Specifically, a novel modality fusion scheme is presented that the image of one modality is translated to the other one through an asymmetric modality translator, then fused with its corresponding paired image. The fusion result is fed as the input to a discriminator for inference. The training of the translator is supervised by an asymmetric modality translation loss. Besides, an illumination normalization module based on Pattern of Local Gravitational Force (PLGF) representation is used to reduce the impact of illumination variation. We conduct extensive experiments on three public datasets, which validate that our method is effective in detecting various types of attacks and achieves state of the art performance under different evaluation protocols.


Tensor Programs IIb Architectural Universality of Neural Tangent Kernel Training Dynamics. Yang (2020a) recently showed that the Neural Tangent Kernel (NTK) at initialization has an infinite width limit for a large class of architectures including modern staples such as ResNet and Transformers. However, their analysis does not apply to training. Here, we show the same neural networks (in the so called NTK parametrization) during training follow a kernel gradient descent dynamics in function space, where the kernel is the infinite width NTK. This completes the proof of the architectural universality of NTK behavior. To achieve this result, we apply the Tensor Programs technique Write the entire SGD dynamics inside a Tensor Program and analyze it via the Master Theorem. To facilitate this proof, we develop a graphical notation for Tensor Programs.


Acceleration of amyloid fibril formation by multichannel sonochemical reactor. Formation of amyloid fibrils of various amyloidogenic proteins is dramatically enhanced by ultrasound irradiation. For applying this phenomenon to the study of protein aggregation science and diagnosis of neurodegenerative diseases, a multichannel ultrasound irradiation system with individually adjustable ultrasound irradiation conditions is necessary. Here, we develop a sonochemical reaction system, where an ultrasonic transducer is placed in each well of a 96 well microplate to perform ultrasonic irradiation of sample solutions under various conditions with high reproducibility, and applied it for studying amyloid fibril formation of amyloid beta , alpha synuclein, beta 2 microglobulin, and lysozyme. The results clearly show that our instrument is superior to conventional shaking method in terms of degree of acceleration and reproducibility of fibril formation reaction. The acceleration degree is controllable by controlling the driving voltage applied to each transducer. We have thus succeeded in developing a useful tool for the study of amyloid fibril formation in various proteins.


Pfister Numbers over Rigid Fields. For certain types of quadratic forms lying in the n th power of the fundamental ideal, we compute upper bounds and where possible exact values for the minimal number of general n fold Pfister forms, that are needed to write the Witt class of that given form as the sum of the Witt classes of those n fold Pfister forms. We restrict ourselves mostly to the case of so called rigid fields, i.e. fields in which binary anisotropic forms represent at most 2 square classes.


Defending against Model Stealing via Verifying Embedded External Features. Obtaining a well trained model involves expensive data collection and training procedures, therefore the model is a valuable intellectual property. Recent studies revealed that adversaries can steal' deployed models even when they have no training samples and can not get access to the model parameters or structures. Currently, there were some defense methods to alleviate this threat, mostly by increasing the cost of model stealing. In this paper, we explore the defense from another angle by verifying whether a suspicious model contains the knowledge of defender specified emph external features . Specifically, we embed the external features by tempering a few training samples with style transfer. We then train a meta classifier to determine whether a model is stolen from the victim. This approach is inspired by the understanding that the stolen models should contain the knowledge of features learned by the victim model. We examine our method on both CIFAR 10 and ImageNet datasets. Experimental results demonstrate that our method is effective in detecting different types of model stealing simultaneously, even if the stolen model is obtained via a multi stage stealing process. The codes for reproducing main results are available at Github (https github.com zlh thu StealingVerification).


The Long Moody construction and twisted Alexander invariants. In 1994, Long and Moody introduced a method to construct a new representation of the braid group from the representation of the braid group or the semidirect product of the braid group and the free group. In this paper, we show that its matrix presentation is written using the Fox derivation, and also a relation with twisted Alexander invariants.


AnswerQuest A System for Generating Question Answer Items from Multi Paragraph Documents. One strategy for facilitating reading comprehension is to present information in a question and answer format. We demo a system that integrates the tasks of question answering (QA) and question generation (QG) in order to produce Q A items that convey the content of multi paragraph documents. We report some experiments for QA and QG that yield improvements on both tasks, and assess how they interact to produce a list of Q A items for a text. The demo is accessible at qna.sdl.com.


Spectrum of weighted Birkhoff average. Let s n n in mathbb N be a decreasing nonsummable sequence of positive reals. In this paper, we investigate the weighted Birkhoff average frac 1 S n sum k 0 n 1 s k phi(T kx) on aperiodic irreducible subshift of finite type Sigma bf A where phi Sigma bf A mapsto mathbb R is a continuous potential. Firstly, we show the entropy spectrum of the weighed Birkhoff averages remains the same as that of the Birkhoff averages. Then we prove that the packing spectrum of the weighed Birkhoff averages equals to either that of the Birkhoff averages or the whole space.


Reachability Problems for Transmission Graphs. Let P be a set of n points in the plane where each point p of P is associated with a radius r p 0 .The transmission graph G (P,E) of P is defined as the directed graph such that E contains an edge from p to q if and only if pq leq r p for any two points p and q in P , where pq denotes the Euclidean distance between p and q . In this paper, we present a data structure of size O(n 5 3 ) such that for any two points in P , we can check in O(n 2 3 ) time if there is a path in G between the two points. This is the first data structure for answering reachability queries whose performance depends only on n but not on the number of edges.


Game Theoretic Models of Moral and Other Regarding Agents (extended abstract). We investigate Kantian equilibria in finite normal form games, a class of non Nashian, morally motivated courses of action that was recently proposed in the economics literature. We highlight a number of problems with such equilibria, including computational intractability, a high price of miscoordination, and problematic extension to general normal form games. We give such a generalization based on concept of program equilibria, and point out that that a practically relevant generalization may not exist. To remedy this we propose some general, intuitive, computationally tractable, other regarding equilibria that are special cases Kantian equilibria, as well as a class of courses of action that interpolates between purely self regarding and Kantian behavior.


Direct Construction of Optimal Z Complementary Code Sets for all Possible Even Length by Using Pseudo Boolean Functions. Z complementary code set (ZCCS) are well known to be used in multicarrier code division multiple access (MCCDMA) system to provide a interference free environment. Based on the existing literature, the direct construction of optimal ZCCSs are limited to its length. In this paper, we are interested in constructing optimal ZCCSs of all possible even lengths using Pseudo Boolean functions. The maximum column sequence peakto man envelop power ratio (PMEPR) of the proposed ZCCSs is upper bounded by two, which may give an extra benefit in managing PMEPR in an ZCCS based MC CDMA system, as well as the ability to handle a large number of users.


Large Scale Benchmarks for the Job Shop Scheduling Problem. This report contains the description of two novel job shop scheduling benchmarks that resemble instances of real scheduling problem as they appear in industry. In particular, the aim was to provide large scale benchmarks (up to 1 million operations) to test the state of the art scheduling solutions on problems that are closer to what occurs in a real industrial context. The first benchmark is an extension of the well known Taillard benchmark (1992), while the second is a collection of scheduling instances with a known optimum solution.


FUIM Fuzzy Utility Itemset Mining. Because of usefulness and comprehensibility, fuzzy data mining has been extensively studied and is an emerging topic in recent years. Compared with utility driven itemset mining technologies, fuzzy utility mining not only takes utilities (e.g., profits) into account, but also considers quantities of items in each transaction for discovering high fuzzy utility itemsets (HFUIs). Thus, fuzziness can be regard as a key criterion to select high utility itemsets, while the exiting algorithms are not efficient enough. In this paper, an efficient one phase algorithm named Fuzzy driven Utility Itemset Miner (FUIM) is proposed to find out a complete set of HFUIs effectively. In addition, a novel compact data structure named fuzzy list keeps the key information from quantitative transaction databases. Using fuzzy list, FUIM can discover HFUIs from transaction databases efficiently and effectively. Both completeness and correctness of the FUIM algorithm are proved by five theorems. At last, substantial experiments test three terms (runtime cost, memory consumption, and scalability) to confirm that FUIM considerably outperforms the state of the art algorithms.


Spatio Temporal Perturbations for Video Attribution. The attribution method provides a direction for interpreting opaque neural networks in a visual way by identifying and visualizing the input regions pixels that dominate the output of a network. Regarding the attribution method for visually explaining video understanding networks, it is challenging because of the unique spatiotemporal dependencies existing in video inputs and the special 3D convolutional or recurrent structures of video understanding networks. However, most existing attribution methods focus on explaining networks taking a single image as input and a few works specifically devised for video attribution come short of dealing with diversified structures of video understanding networks. In this paper, we investigate a generic perturbation based attribution method that is compatible with diversified video understanding networks. Besides, we propose a novel regularization term to enhance the method by constraining the smoothness of its attribution results in both spatial and temporal dimensions. In order to assess the effectiveness of different video attribution methods without relying on manual judgement, we introduce reliable objective metrics which are checked by a newly proposed reliability measurement. We verified the effectiveness of our method by both subjective and objective evaluation and comparison with multiple significant attribution methods.


Sample based Approximation of Nash in Large Many Player Games via Gradient Descent. Nash equilibrium is a central concept in game theory. Several Nash solvers exist, yet none scale to normal form games with many actions and many players, especially those with payoff tensors too big to be stored in memory. In this work, we propose an approach that iteratively improves an approximation to a Nash equilibrium through joint play. It accomplishes this by tracing a previously established homotopy that defines a continuum of equilibria for the game regularized with decaying levels of entropy. This continuum asymptotically approaches the limiting logit equilibrium, proven by McKelvey and Palfrey (1995) to be unique in almost all games, thereby partially circumventing the well known equilibrium selection problem of many player games. To encourage iterates to remain near this path, we efficiently minimize average deviation incentive via stochastic gradient descent, intelligently sampling entries in the payoff tensor as needed. Monte Carlo estimates of the stochastic gradient from joint play are biased due to the appearance of a nonlinear max operator in the objective, so we introduce additional innovations to the algorithm to alleviate gradient bias. The descent process can also be viewed as repeatedly constructing and reacting to a polymatrix approximation to the game. In these ways, our proposed approach, average deviation incentive descent with adaptive sampling (ADIDAS), is most similar to three classical approaches, namely homotopy type, Lyapunov, and iterative polymatrix solvers. The lack of local convergence guarantees for biased gradient descent prevents guaranteed convergence to Nash, however, we demonstrate through extensive experiments the ability of this approach to approximate a unique Nash in normal form games with as many as seven players and twenty one actions (several billion outcomes) that are orders of magnitude larger than those possible with prior algorithms.


OVRseen Auditing Network Traffic and Privacy Policies in Oculus VR. Virtual reality (VR) is an emerging technology that enables new applications but also introduces privacy risks. In this paper, we focus on Oculus VR (OVR), the leading platform in the VR space and we provide the first comprehensive analysis of personal data exposed by OVR apps and the platform itself, from a combined networking and privacy policy perspective. We experimented with the Quest 2 headset and tested the most popular VR apps available on the official Oculus and the SideQuest app stores. We developed OVRseen, a methodology and system for collecting, analyzing, and comparing network traffic and privacy policies on OVR. On the networking side, we captured and decrypted network traffic of VR apps, which was previously not possible on OVR, and we extracted data flows, defined as app, data type, destination . Compared to the mobile and other app ecosystems, we found OVR to be more centralized and driven by tracking and analytics, rather than by third party advertising. We show that the data types exposed by VR apps include personally identifiable information (PII), device information that can be used for fingerprinting, and VR specific data types. By comparing the data flows found in the network traffic with statements made in the apps' privacy policies, we found that approximately 70 of OVR data flows were not properly disclosed. Furthermore, we extracted additional context from the privacy policies, and we observed that 69 of the data flows were used for purposes unrelated to the core functionality of apps.


Sharp lower bounds for moments of quadratic Dirichlet L functions. We establish sharp lower bounds for the k th moment in the range 0 leq k leq 1 of the family of quadratic Dirichlet L functions at the central point.


Truly Concurrent Process Algebra with Localities. The well known process algebras, such as CCS, ACP and pi calculus, capture the interleaving concurrency based on bisimilarity semantics. We did some work on truly concurrent process algebras, such as CTC, APTC and pi tc , capture the true concurrency based on truly concurrent bisimilarities, such as pomset bisimilarity, step bisimilarity, history preserving (hp ) bisimilarity and hereditary history preserving (hhp ) bisimilarity. Truly concurrent process algebras are generalizations of the corresponding traditional process algebras. In this book, we introduce localities into truly concurrent process algebras, based on the work on process algebra with localities.


A Novel Cluster Detection of COVID 19 Patients and Medical Disease Conditions Using Improved Evolutionary Clustering Algorithm Star. With the increasing number of samples, the manual clustering of COVID 19 and medical disease data samples becomes time consuming and requires highly skilled labour. Recently, several algorithms have been used for clustering medical datasets deterministically however, these definitions have not been effective in grouping and analysing medical diseases. The use of evolutionary clustering algorithms may help to effectively cluster these diseases. On this presumption, we improved the current evolutionary clustering algorithm star (ECA ), called iECA , in three manners (i) utilising the elbow method to find the correct number of clusters (ii) cleaning and processing data as part of iECA to apply it to multivariate and domain theory datasets (iii) using iECA for real world applications in clustering COVID 19 and medical disease datasets. Experiments were conducted to examine the performance of iECA against state of the art algorithms using performance and validation measures (validation measures, statistical benchmarking, and performance ranking framework). The results demonstrate three primary findings. First, iECA was more effective than other algorithms in grouping the chosen medical disease datasets according to the cluster validation criteria. Second, iECA exhibited the lower execution time and memory consumption for clustering all the datasets, compared to the current clustering methods analysed. Third, an operational framework was proposed to rate the effectiveness of iECA against other algorithms in the datasets analysed, and the results indicated that iECA exhibited the best performance in clustering all medical datasets. Further research is required on real world multi dimensional data containing complex knowledge fields for experimental verification of iECA compared to evolutionary algorithms.


Kernel optimization for Low Rank Multi Fidelity Algorithms. One of the major challenges for low rank multi fidelity (MF) approaches is the assumption that low fidelity (LF) and high fidelity (HF) models admit "similar" low rank kernel representations. Low rank MF methods have traditionally attempted to exploit low rank representations of linear kernels, which are kernel functions of the form K(u,v) v T u for vectors u and v . However, such linear kernels may not be able to capture low rank behavior, and they may admit LF and HF kernels that are not similar. Such a situation renders a naive approach to low rank MF procedures ineffective. In this paper, we propose a novel approach for the selection of a near optimal kernel function for use in low rank MF methods. The proposed framework is a two step strategy wherein (1) hyperparameters of a library of kernel functions are optimized, and (2) a particular combination of the optimized kernels is selected, through either a convex mixture (Additive Kernels) or through a data driven optimization (Adaptive Kernels). The two resulting methods for this generalized framework both utilize only the available inexpensive low fidelity data and thus no evaluation of high fidelity simulation model is needed until a kernel is chosen. These proposed approaches are tested on five non trivial problems including multi fidelity surrogate modeling for one and two species molecular systems, gravitational many body problem, associating polymer networks, plasmonic nano particle arrays, and an incompressible flow in channels with stenosis. The results for these numerical experiments demonstrate the numerical stability efficiency of both proposed kernel function selection procedures, as well as high accuracy of their resultant predictive models for estimation of quantities of interest. Comparisons against standard linear kernel procedures also demonstrate increased accuracy of the optimized kernel approaches.


Hardness of Detecting Abelian and Additive Square Factors in Strings. We prove 3SUM hardness (no strongly subquadratic time algorithm, assuming the 3SUM conjecture) of several problems related to finding Abelian square and additive square factors in a string. In particular, we conclude conditional optimality of the state of the art algorithms for finding such factors. Overall, we show 3SUM hardness of (a) detecting an Abelian square factor of an odd half length, (b) computing centers of all Abelian square factors, (c) detecting an additive square factor in a length n string of integers of magnitude n mathcal O (1) , and (d) a problem of computing a double 3 term arithmetic progression (i.e., finding indices i ne j such that (x i x j) 2 x (i j) 2 ) in a sequence of integers x 1, dots,x n of magnitude n mathcal O (1) . Problem (d) is essentially a convolution version of the AVERAGE problem that was proposed in a manuscript of Erickson. We obtain a conditional lower bound for it with the aid of techniques recently developed by Dudek et al. STOC 2020 . Problem (d) immediately reduces to problem (c) and is a step in reductions to problems (a) and (b). In conditional lower bounds for problems (a) and (b) we apply an encoding of Amir et al. ICALP 2014 and extend it using several string gadgets that include arbitrarily long Abelian square free strings. Our reductions also imply conditional lower bounds for detecting Abelian squares in strings over a constant sized alphabet. We also show a subquadratic upper bound in this case, applying a result of Chan and Lewenstein STOC 2015 .


Reinforcement Learning for Orientation Estimation Using Inertial Sensors with Performance Guarantee. This paper presents a deep reinforcement learning (DRL) algorithm for orientation estimation using inertial sensors combined with magnetometer. The Lyapunov method in control theory is employed to prove the convergence of orientation estimation errors. Based on the theoretical results, the estimator gains and a Lyapunov function are parametrized by deep neural networks and learned from samples. The DRL estimator is compared with three well known orientation estimation methods on both numerical simulations and real datasets collected from commercially available sensors. The results show that the proposed algorithm is superior for arbitrary estimation initialization and can adapt to very large angular velocities for which other algorithms can be hardly applicable. To the best of our knowledge, this is the first DRL based orientation estimation method with estimation error boundedness guarantee.


The Surface response around a sharply resonant surface polariton mode is simply a Lorentzian. At the planar interface between a material and vacuum, the complex surface response S(omega) eps(omega) 1 eps(omega) 1 , with eps(omega) the relative complex dielectric permittivity of the material, exhibit resonances, typical of the surface polariton modes, when eps(omega) 1. We show that for a moderately sharp resonance, S(omega) is satisfactorily described with a mere (complex) Lorentzian, independently of the details affecting the various bulk resonances describing ) eps(omega). Remarkably, this implies a quantitative correlation between the resonant behaviors of Re S(omega) and Im S(omega) , respectively associated to dispersive and dissipative effects in the surface near field. We show that this "strong resonance" approximation easily applies, and discuss its limits, based upon published data for sapphire, CaF2 and BaF2. Extension to interfaces between two media or to a non planar interface is briefly considered.


Relay Selection and Resource Allocation for Ultra Reliable Uplink Transmission in Smart Factory Scenarios. In this paper, a relay aided two phase transmission protocol for the smart factory scenario is proposed. This protocol aims at enabling all robots' ultra reliable target number of uplink critical data transmission within a latency constraint by jointly optimizing the relay selection, resource block (RB) assignment, and transmit power allocation. Such protocol design is formulated as a mixed integer and strictly non convex problem where optimization variables are mutual coupling, which is definitely challenging. Instead of conventional methods designed for solving the problem, we leverage the properties of the relative entropy function to equivalently transform the problem without introducing extra constraints. As the packet error probability requirements of each robot under two possible transmission modes are coupled in one overall reliability constraint, the big M technique is applied to decouple it into two corresponding reliability constraints. One is for direct transmission mode, and the other is for cooperative transmission mode. Moreover, both non convex penalty (NCP) and quadratic penalty (QP) approaches are utilized to deal with the binary indicator constraints. Based on such penalty methods, a sequence of penalized approximated convex problems can be iteratively solved for sub optimal solutions. Numerical results demonstrate the efficiency of such two penalty methods from the perspectives of sub optimal values of total transmit power and convergence rate. Further, the impacts of reliability, the number and location of relays, the number of robots, the target number of data bits on the total power consumption are analyzed.


Extending On chain Trust to Off chain Trustworthy Blockchain Data Collection using Trusted Execution Environment (TEE). Blockchain creates a secure environment on top of strict cryptographic assumptions and rigorous security proofs. It permits on chain interactions to achieve trustworthy properties such as traceability, transparency, and accountability. However, current blockchain trustworthiness is only confined to on chain, creating a "trust gap" to the physical, off chain environment. This is due to the lack of a scheme that can truthfully reflect the physical world in a real time and consistent manner. Such an absence hinders further real world blockchain applications, especially for security sensitive ones. In this paper, we propose a scheme to extend blockchain trust from on chain to off chain, and take trustworthy vaccine transportation as an example. Our scheme consists of 1) a Trusted Execution Environment (TEE) enabled trusted environment monitoring system built with the Arm Cortex M33 microcontroller that continuously senses the inside of a vaccine box through trusted sensors and generates anti forgery data and 2) a consistency protocol to upload the environment status data from the TEE system to blockchain in a truthful, real time consistent, continuous and fault tolerant fashion. Our security analysis indicates that no adversary can tamper with the vaccine in any way without being captured. We carry out an experiment to record the internal status of a vaccine shipping box during transportation, and the results indicate that the proposed system incurs an average latency of 84 ms in local sensing and processing followed by an average latency of 130 ms to have the sensed data transmitted to and available in the blockchain.


Rank Consistency Deep Hashing for Scalable Multi Label Image Search. As hashing becomes an increasingly appealing technique for large scale image retrieval, multi label hashing is also attracting more attention for the ability to exploit multi level semantic contents. In this paper, we propose a novel deep hashing method for scalable multi label image search. Unlike existing approaches with conventional objectives such as contrast and triplet losses, we employ a rank list, rather than pairs or triplets, to provide sufficient global supervision information for all the samples. Specifically, a new rank consistency objective is applied to align the similarity orders from two spaces, the original space and the hamming space. A powerful loss function is designed to penalize the samples whose semantic similarity and hamming distance are mismatched in two spaces. Besides, a multi label softmax cross entropy loss is presented to enhance the discriminative power with a concise formulation of the derivative function. In order to manipulate the neighborhood structure of the samples with different labels, we design a multi label clustering loss to cluster the hashing vectors of the samples with the same labels by reducing the distances between the samples and their multiple corresponding class centers. The state of the art experimental results achieved on three public multi label datasets, MIRFLICKR 25K, IAPRTC12 and NUS WIDE, demonstrate the effectiveness of the proposed method.


Streaming Multi talker Speech Recognition with Joint Speaker Identification. In multi talker scenarios such as meetings and conversations, speech processing systems are usually required to transcribe the audio as well as identify the speakers for downstream applications. Since overlapped speech is common in this case, conventional approaches usually address this problem in a cascaded fashion that involves speech separation, speech recognition and speaker identification that are trained independently. In this paper, we propose Streaming Unmixing, Recognition and Identification Transducer (SURIT) a new framework that deals with this problem in an end to end streaming fashion. SURIT employs the recurrent neural network transducer (RNN T) as the backbone for both speech recognition and speaker identification. We validate our idea on the LibrispeechMix dataset a multi talker dataset derived from Librispeech, and present encouraging results.


Improving Video Instance Segmentation via Temporal Pyramid Routing. Video Instance Segmentation (VIS) is a new and inherently multi task problem, which aims to detect, segment and track each instance in a video sequence. Existing approaches are mainly based on single frame features or single scale features of multiple frames, where temporal information or multi scale information is ignored. To incorporate both temporal and scale information, we propose a Temporal Pyramid Routing (TPR) strategy to conditionally align and conduct pixel level aggregation from a feature pyramid pair of two adjacent frames. Specifically, TPR contains two novel components, including Dynamic Aligned Cell Routing (DACR) and Cross Pyramid Routing (CPR), where DACR is designed for aligning and gating pyramid features across temporal dimension, while CPR transfers temporally aggregated features across scale dimension. Moreover, our approach is a plug and play module and can be easily applied to existing instance segmentation methods. Extensive experiments on YouTube VIS dataset demonstrate the effectiveness and efficiency of the proposed approach on several state of the art instance segmentation methods. Codes and trained models will be publicly available to facilitate future research.( url https github.com lxtGH TemporalPyramidRouting ).


The nilpotency of the prime radical of a Goldie module. With the notion of prime submodule defined by F. Raggi et.al. we prove that the intersection of all prime submodules of a Goldie module M , is a nilpotent submodule provided that M is retractable and M ( Lambda) projective for every index set Lambda . This extends the well known fact that in a left Goldie ring, the prime radical is nilpotent.


Analytical Models for Motifs in Temporal Networks Discovering Trends and Anomalies. Dynamic evolving networks capture temporal relations in domains such as social networks, communication networks, and financial transaction networks. In such networks, temporal motifs, which are repeated sequences of time stamped edges transactions, offer valuable information about the networks' evolution and function. However, currently no analytical models for temporal graphs exist and there are no models that would allow for scalable modeling of temporal motif frequencies over time. Here, we develop the Temporal Activity State Block Model (TASBM), to model temporal motifs in temporal graphs. We develop efficient model fitting methods and derive closed form expressions for the expected motif frequencies and their variances in a given temporal network, thus enabling the discovery of statistically significant temporal motifs. Our TASMB framework can accurately track the changes in the expected motif frequencies over time, and also scales well to networks with tens of millions of edges transactions as it does not require time consuming generation of many random temporal networks and then computing motif counts for each one of them. We show that TASBM is able to model changes in temporal activity over time in a network of financial transactions, a phone call, and an email network. Additionally, we show that deviations from the expected motif counts calculated by our analytical framework correspond to anomalies in the financial transactions and phone call networks.


Symbolic integration in the spirit of Liouville, Abel and Lie. We provide a Liouville principle for integration in terms of elliptic integrals. Our methods are essentially those of Abel and Liouville changed to modern notation. We expose Lie theoretic aspect of Liouville's work.


Diffusion approximations in population genetics and the rate of Muller's ratchet. Diffusion theory is a central tool of modern population genetics, yielding simple expressions for fixation probabilities and other quantities that are not easily derived from the underlying Wright Fisher model. Unfortunately, the textbook derivation of diffusion equations as scaling limits requires evolutionary parameters (selection coefficients, mutation rates) to scale like the inverse population size a severe restriction that does not always reflect biological reality. Here we note that the Wright Fisher model can be approximated by diffusion equations under more general conditions, including in regimes where selection and or mutation are strong compared to genetic drift. As an illustration, we use a diffusion approximation of the Wright Fisher model to improve estimates for the expected time to fixation of a strongly deleterious allele, i.e. the rate of Muller's ratchet.


Heterogeneous Face Frontalization via Domain Agnostic Learning. Recent advances in deep convolutional neural networks (DCNNs) have shown impressive performance improvements on thermal to visible face synthesis and matching problems. However, current DCNN based synthesis models do not perform well on thermal faces with large pose variations. In order to deal with this problem, heterogeneous face frontalization methods are needed in which a model takes a thermal profile face image and generates a frontal visible face. This is an extremely difficult problem due to the large domain as well as large pose discrepancies between the two modalities. Despite its applications in biometrics and surveillance, this problem is relatively unexplored in the literature. We propose a domain agnostic learning based generative adversarial network (DAL GAN) which can synthesize frontal views in the visible domain from thermal faces with pose variations. DAL GAN consists of a generator with an auxiliary classifier and two discriminators which capture both local and global texture discriminations for better synthesis. A contrastive constraint is enforced in the latent space of the generator with the help of a dual path training strategy, which improves the feature vector discrimination. Finally, a multi purpose loss function is utilized to guide the network in synthesizing identity preserving cross domain frontalization. Extensive experimental results demonstrate that DAL GAN can generate better quality frontal views compared to the other baseline methods.


Composing games into complex institutions. Game theory is used by all behavioral sciences, but its development has long centered around tools for relatively simple games and toy systems, such as the economic interpretation of equilibrium outcomes. Our contribution, compositional game theory, permits another approach of equally general appeal the high level design of large games for expressing complex architectures and representing real world institutions faithfully. Compositional game theory, grounded in the mathematics underlying programming languages, and introduced here as a general computational framework, increases the parsimony of game representations with abstraction and modularity, accelerates search and design, and helps theorists across disciplines express real world institutional complexity in well defined ways.


Artificial Intelligence for IT Operations (AIOPS) Workshop White Paper. Artificial Intelligence for IT Operations (AIOps) is an emerging interdisciplinary field arising in the intersection between the research areas of machine learning, big data, streaming analytics, and the management of IT operations. AIOps, as a field, is a candidate to produce the future standard for IT operation management. To that end, AIOps has several challenges. First, it needs to combine separate research branches from other research fields like software reliability engineering. Second, novel modelling techniques are needed to understand the dynamics of different systems. Furthermore, it requires to lay out the basis for assessing time horizons and uncertainty for imminent SLA violations, the early detection of emerging problems, autonomous remediation, decision making, support of various optimization objectives. Moreover, a good understanding and interpretability of these aiding models are important for building trust between the employed tools and the domain experts. Finally, all this will result in faster adoption of AIOps, further increase the interest in this research field and contribute to bridging the gap towards fully autonomous operating IT systems. The main aim of the AIOPS workshop is to bring together researchers from both academia and industry to present their experiences, results, and work in progress in this field. The workshop aims to strengthen the community and unite it towards the goal of joining the efforts for solving the main challenges the field is currently facing. A consensus and adoption of the principles of openness and reproducibility will boost the research in this emerging area significantly.


The role of double ionization on the generation of doubly charged ions in copper vacuum arcs insight from particle in cell direct simulation Monte Carlo methods. Metal vapour vacuum arcs are capable to generate multiply charged metallic ions, which are widely used in fields such as ion deposition, ion thrusters, and ion sources, etc. According to the stationary model of cathode spot, those ions are generated by electron impact single ionization in a step wise manner, which is M M M2 ... mainly. This paper is designed to study quantitatively the role of double ionization M M2 in the breakdown initiation of copper vacuum arcs. A direct simulation Monte Carlo (DSMC) scheme of double ionization is proposed and incorporated into a 2D particle in cell (PIC) method. The super particles of Cu2 ions generated from different channels are labelled independently in the PIC DSMC modelling of vacuum arc breakdown. The cathode erosion rate based on PIC modelling is about 40 mu g C in arc burning regime, which agrees well with previous experiments. The temporal discharge behaviours such as arc current, arc voltage, and ionization degree of arc plasma, are influenced with or without double ionization negligibly. However, additional Cu2 ions are generated near the cathode in breakdown initiation from the double ionization channel, with a lower kinetic energy on average. Therefore, the results on spatial distribution and energy spectra of Cu2 ions are different with or without double ionization. This paper provides a quantitative research method to evaluate the role of multiply ionization in vacuum arcs.


Internal wave and turbulence observations with very high resolution temperature sensors along the Cabauw tower. Knowledge about the characteristics of the atmospheric boundary layer are vital for the redistribution of air and suspended contents that are particularly driven by turbulent motions. Despite many modelling studies, detailed observations are still demanded of the development of turbulent exchange under stable and unstable conditions. In this paper we present an attempt to observationally detail atmospheric internal waves, under stable conditions, and associated turbulent overturning, under quasi stable and unstable conditions. Therefore, we mounted 198 high resolution temperature T sensors on a cable. The instrumented cable was attached along the 213 m tall mast of Cabauw, the Netherlands, during late summer 2017. The mast has standard and special meteorological equipment at extendable booms every 20 m in height. A sonic turbulence anemometer is at 60 m above ground. The extra, originally underwater , T sensor cable was suspended down from the 206 m level, temporarily for about 3 months. While in water the sensors have a response time of tw 0.4 s and drift of 0.001 degC per month, in air the response time ta 3 s is relatively slow and the apparent drift of about 0.1 degC per month relatively large. Least performance is during daytime. These T sensor characteristics hamper quantitative atmospheric turbulence research, as it results in a relatively narrow inertial subrange of only one order of magnitude. Nevertheless, height time images from two contrasting days show common nocturnal marginally stable density stratification supporting internal waves up to the buoyancy period of about 300 s, shear and convective deformation of the stratification over the entire 197 m range of observations.


Optical vortices in nanophotonics. In the last two decades, optical vortices carried by twisted light wavefronts have attracted a great deal of interest, providing not only new physical insights into light matter interactions, but also a transformative platform for boosting optical information capacity. Meanwhile, advances in nanoscience and nanotechnology lead to the emerging field of nanophotonics, offering an unprecedented level of light manipulation via nanostructured materials and devices. Many exciting ideas and concepts come up when optical vortices meet nanophotonic devices. Here, we provide a mini review on recent achievements made in nanophotonics for the generation and detection of optical vortices and some of their applications.


Learning Ideological Embeddings from Information Cascades. Modeling information cascades in a social network through the lenses of the ideological leaning of its users can help understanding phenomena such as misinformation propagation and confirmation bias, and devising techniques for mitigating their toxic effects. In this paper we propose a stochastic model to learn the ideological leaning of each user in a multidimensional ideological space, by analyzing the way politically salient content propagates. In particular, our model assumes that information propagates from one user to another if both users are interested in the topic and ideologically aligned with each other. To infer the parameters of our model, we devise a gradient based optimization procedure maximizing the likelihood of an observed set of information cascades. Our experiments on real world political discussions on Twitter and Reddit confirm that our model is able to learn the political stance of the social media users in a multidimensional ideological space.


High order FDTD schemes for Maxwell's interface problems with discontinuous coefficients and complex interfaces based on the Correction Function Method. We propose high order FDTD schemes based on the Correction Function Method (CFM) for Maxwell's interface problems with discontinuous coefficients and complex interfaces. The key idea of the CFM is to model the correction function near an interface to retain the order of a finite difference approximation. For this, we solve a system of PDEs based on the original problem by minimizing an energy functional. The CFM is applied to the standard Yee scheme and a fourth order FDTD scheme. The proposed CFM FDTD schemes are verified in 2 D using the transverse magnetic mode (TM z ). Numerical examples include scattering of magnetic and non magnetic dielectric cylinders, and problems with manufactured solutions using various complex interfaces and discontinuous piecewise varying coefficients. Long time simulations are also performed to provide numerical evidences of the stability of the proposed numerical approach. The proposed CFM FDTD schemes achieve up to fourth order convergence in L 2 norm and provide approximations devoid of spurious oscillations.


Second Order Component Analysis for Fault Detection. Process monitoring based on neural networks is getting more and more attention. Compared with classical neural networks, high order neural networks have natural advantages in dealing with heteroscedastic data. However, high order neural networks might bring the risk of overfitting and learning both the key information from original data and noises or anomalies. Orthogonal constraints can greatly reduce correlations between extracted features, thereby reducing the overfitting risk. This paper proposes a novel fault detection method called second order component analysis (SCA). SCA rules out the heteroscedasticity of pro cess data by optimizing a second order autoencoder with orthogonal constraints. In order to deal with this constrained optimization problem, a geometric conjugate gradient algorithm is adopted in this paper, which performs geometric optimization on the combination of Stiefel manifold and Euclidean manifold. Extensive experiments on the Tennessee Eastman benchmark pro cess show that SCA outperforms PCA, KPCA, and autoencoder in missed detection rate (MDR) and false alarm rate (FAR).


Direction Based Jamming Detection and Suppression in mmWave Massive MIMO Networks. In this paper, we study the problem of physical layer security in the uplink of millimeter wave massive multiple input multiple output (MIMO) networks and propose a jamming detection and suppression method. The proposed method is based on directional information of the received signals at the base station antenna array. The proposed jamming detection method can accurately detect both the existence and direction of the jammer using the received pilot signals in the training phase. The obtained information is then exploited to develop a channel estimator that excludes the jammer's angular subspace from received training signals. The estimated channel information is then used for designing a combiner at the base station that is able to effectively cancel out the deliberate interference of the jammer. By numerical simulations, we evaluate the performance of the proposed jamming detection method in terms of correct detection probability and false alarm probability and show its effectiveness when the jammer's power is substantially lower than the user's power. Also, our results show that the proposed jamming suppression method can achieve a very close spectral efficiency as the case of no jamming in the network


On a Proof of the Strong Law of Large Numbers. Inspired by a recent preprint of N. Curien, we provided what may be a new and elementary proof of the Law of Large Numbers.


Characterizing principal minors of symmetric matrices via determinantal multiaffine polynomials. Here we consider the image of the principal minor map of symmetric matrices over an arbitrary unique factorization domain R . By exploiting a connection with symmetric determinantal representations, we characterize the image of the principal minor map through the condition that certain polynomials coming from so called Rayleigh differences are squares in the polynomial ring over R . In almost all cases, one can characterize the image of the principal minor map using the orbit of Cayley's hyperdeterminant under the action of (SL 2(R)) n rtimes S n . Over the complex numbers, this recovers a characterization of Oeding from 2011, and over the reals, the orbit of a single additional quadratic inequality suffices to cut out the image. Applications to other symmetric determinantal representations are also discussed.


Numerical study of Langmuir wave coalescence in laser plasma interaction. Type III burst radio signals can be mimicked in the laboratory via laser plasma interaction. Instead of an electron beam generating Langmuir waves (LW) in the interplanetary medium, the LWs are created by a laser interacting with a millimeter sized plasma through the stimulated Raman instability. In both cases, the LWs feed the Langmuir decay instability which scatters them in several directions. The resulting LWs may couple to form electromagnetic emission at twice the plasma frequency, which has been detected in the interplanetary medium, and recently in a laboratory laser experiment Marqu es et al. Phys. Rev. Lett. 124, 135001 (2020) . This article presents the first numerical analysis of this laser configuration using particle in cell simulations, providing details on the wave spectra that are too difficult to measure in experiments. The role of some parameters is addressed, with a focus on laser intensity, in order to illustrate the behavior of the electromagnetic emission's angular distribution and polarization.


Emerging Trends for Global DevOps A New Zealand Perspective. The DevOps phenomenon is gaining popularity through its ability to support continuous value delivery and ready accommodation of change. However, given the relative immaturity and general confusion about DevOps, a common view of expectations from a DevOps role is lacking. Through investigation of online job advertisements, combined with interviews, we identified key Knowledge Areas, Skills and Capabilities for a DevOps role and their relative importance in New Zealand's job market. Our analysis also revealed the global dimensions and the emerging nature of the DevOps role in GSE projects. This research adds a small advanced economy (New Zealand) perspective to the literature on DevOps job advertisements and should be of value to employers, job seekers, researchers as well educators and policy makers.


High dimensional Bayesian Optimization for CNN Auto Pruning with Clustering and Rollback. Pruning has been widely used to slim convolutional neural network (CNN) models to achieve a good trade off between accuracy and model size so that the pruned models become feasible for power constrained devices such as mobile phones. This process can be automated to avoid the expensive hand crafted efforts and to explore a large pruning space automatically so that the high performance pruning policy can be achieved efficiently. Nowadays, reinforcement learning (RL) and Bayesian optimization (BO) based auto pruners are widely used due to their solid theoretical foundation, universality, and high compressing quality. However, the RL agent suffers from long training times and high variance of results, while the BO agent is time consuming for high dimensional design spaces. In this work, we propose an enhanced BO agent to obtain significant acceleration for auto pruning in high dimensional design spaces. To achieve this, a novel clustering algorithm is proposed to reduce the dimension of the design space to speedup the searching process. Then, a roll back algorithm is proposed to recover the high dimensional design space so that higher pruning accuracy can be obtained. We validate our proposed method on ResNet, MobileNet, and VGG models, and our experiments show that the proposed method significantly improves the accuracy of BO when pruning very deep CNN models. Moreover, our method achieves lower variance and shorter time than the RL based counterpart.


Collective eXplainable AI Explaining Cooperative Strategies and Agent Contribution in Multiagent Reinforcement Learning with Shapley Values. While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and general public applications, it is essential to develop methods that make it better understood and more interpretable. This study proposes a novel approach to explain cooperative strategies in multiagent RL using Shapley values, a game theory concept used in XAI that successfully explains the rationale behind decisions taken by Machine Learning algorithms. Through testing common assumptions of this technique in two cooperation centered socially challenging multi agent environments environments, this article argues that Shapley values are a pertinent way to evaluate the contribution of players in a cooperative multi agent RL context. To palliate the high overhead of this method, Shapley values are approximated using Monte Carlo sampling. Experimental results on Multiagent Particle and Sequential Social Dilemmas show that Shapley values succeed at estimating the contribution of each agent. These results could have implications that go beyond games in economics, (e.g., for non discriminatory decision making, ethical and responsible AI derived decisions or policy making under fairness constraints). They also expose how Shapley values only give general explanations about a model and cannot explain a single run, episode nor justify precise actions taken by agents. Future work should focus on addressing these critical aspects.


Streaming Models for Joint Speech Recognition and Translation. Using end to end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated text. However, cascaded models have the advantage of including automatic speech recognition output, useful for a variety of practical ST systems that often display transcripts to the user alongside the translations. To bridge this gap, recent work has shown initial progress into the feasibility for end to end models to produce both of these outputs. However, all previous work has only looked at this problem from the consecutive perspective, leaving uncertainty on whether these approaches are effective in the more challenging streaming setting. We develop an end to end streaming ST model based on a re translation approach and compare against standard cascading approaches. We also introduce a novel inference method for the joint case, interleaving both transcript and translation in generation and removing the need to use separate decoders. Our evaluation across a range of metrics capturing accuracy, latency, and consistency shows that our end to end models are statistically similar to cascading models, while having half the number of parameters. We also find that both systems provide strong translation quality at low latency, keeping 99 of consecutive quality at a lag of just under a second.


Identification of COVID 19 related Fake News via Neural Stacking. Identification of Fake News plays a prominent role in the ongoing pandemic, impacting multiple aspects of day to day life. In this work we present a solution to the shared task titled COVID19 Fake News Detection in English, scoring the 50th place amongst 168 submissions. The solution was within 1.5 of the best performing solution. The proposed solution employs a heterogeneous representation ensemble, adapted for the classification task via an additional neural classification head comprised of multiple hidden layers. The paper consists of detailed ablation studies further displaying the proposed method's behavior and possible implications. The solution is freely available. url https gitlab.com boshko.koloski covid19 fake news


Query Adaptive Few Shot Object Detection with Heterogeneous Graph Convolutional Networks. Few shot object detection (FSOD) aims to detect never seen objects using few examples. This field sees recent improvement owing to the meta learning techniques by learning how to match between the query image and few shot class examples, such that the learned model can generalize to few shot novel classes. However, currently, most of the meta learning based methods perform pairwise matching between query image regions (usually proposals) and novel classes separately, therefore failing to take into account multiple relationships among them. In this paper, we propose a novel FSOD model using heterogeneous graph convolutional networks. Through efficient message passing among all the proposal and class nodes with three different types of edges, we could obtain context aware proposal features and query adaptive, multiclass enhanced prototype representations for each class, which could help promote the pairwise matching and improve final FSOD accuracy. Extensive experimental results show that our proposed model, denoted as QA FewDet, outperforms the current state of the art approaches on the PASCAL VOC and MSCOCO FSOD benchmarks under different shots and evaluation metrics.


Path dependent Poisson random measures and stochastic integrals constructed from general point processes. In this paper, we consider an extension of the Poisson random measure for the formulation of continuous time reinforcement learning, such that both the frequency and the width of the jumps depend on the path. Starting from a general point process, we define a new Poisson random measure as limit of the linear sum of these counting processes, and name it the Mesgaki random measure. We also construct its Stochastic integral and It o's formula.


Iterated Kalman Methodology For Inverse Problems. This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter to data map is embedded, with the goal of employing techniques from nonlinear Kalman filtering to estimate the parameter given the data. The extended Kalman filter (which we refer to as ExKI in the context of inverse problems) can be effective for some inverse problems approached this way, but is impractical when the forward map is not readily differentiable and is given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Application of ensemble Kalman filters, for example use of the ensemble Kalman inversion (EKI) algorithm, has emerged as a useful tool which overcomes both of these issues it is derivative free and works with a low rank covariance approximation formed from the ensemble. In this paper, we work with the ExKI, EKI, and a variant on EKI which we term unscented Kalman inversion (UKI). The paper contains two main contributions. Firstly, we identify a novel stochastic dynamical system in which the parameter to data map is embedded. We present theory in the linear case to show exponential convergence of the mean of the filtering distribution to the solution of a regularized least squares problem. This is in contrast to previous work in which the EKI has been employed where the dynamical system used leads to algebraic convergence to an unregularized problem. Secondly, we show that the application of the UKI to this novel stochastic dynamical system yields improved inversion results, in comparison with the application of EKI to the same novel stochastic dynamical system.


Impact of self association on the architectural properties of bacterial nucleoid proteins. The chromosomal DNA of bacteria is folded into a compact body called the nucleoid, which is composed essentially of DNA (80 ), RNA (10 ), and a number of different proteins (10 ). These nucleoid proteins act as regulators of gene expression and influence the organization of the nucleoid by bridging, bending, or wrapping the DNA. These so called architectural properties of nucleoid proteins are still poorly understood. For example, the reason why certain proteins compact the DNA coil in certain environments but make instead the DNA more rigid in other environments is the matter of ongoing debates. Here, we address the question of the impact of the self association of nucleoid proteins on their architectural properties and try to determine whether differences in self association are sufficient to induce large changes in the organization of the DNA coil. More specifically, we developed two coarse grained models of proteins, which interact identically with the DNA but self associate differently by forming either clusters or filaments in the absence of the DNA. We showed through Brownian dynamics simulations that self association of the proteins increases dramatically their ability to shape the DNA coil. Moreover, we observed that cluster forming proteins compact significantly the DNA coil (similar to the DNA bridging mode of H NS proteins), whereas filament forming proteins increase instead significantly the stiffness of the DNA chain (similar to the DNA stiffening mode of H NS proteins). This work consequently suggests that the knowledge of the DNA binding properties of the proteins is in itself not sufficient to understand their architectural properties. Rather, their self association properties must also be investigated in detail, because they might actually drive the formation of different DNA protein complexes.


Large Scale Contextualised Language Modelling for Norwegian. We present the ongoing NorLM initiative to support the creation and use of very large contextualised language models for Norwegian (and in principle other Nordic languages), including a ready to use software environment, as well as an experience report for data preparation and training. This paper introduces the first large scale monolingual language models for Norwegian, based on both the ELMo and BERT frameworks. In addition to detailing the training process, we present contrastive benchmark results on a suite of NLP tasks for Norwegian. For additional background and access to the data, models, and software, please see http norlm.nlpl.eu


Deep ReLU Network Expression Rates for Option Prices in high dimensional, exponential L 'evy models. We study the expression rates of deep neural networks (DNNs for short) for option prices written on baskets of d risky assets, whose log returns are modelled by a multivariate L 'evy process with general correlation structure of jumps. We establish sufficient conditions on the characteristic triplet of the L 'evy process X that ensure varepsilon error of DNN expressed option prices with DNNs of size that grows polynomially with respect to mathcal O ( varepsilon 1 ) , and with constants implied in mathcal O ( cdot) which grow polynomially with respect d , thereby overcoming the curse of dimensionality and justifying the use of DNNs in financial modelling of large baskets in markets with jumps. In addition, we exploit parabolic smoothing of Kolmogorov partial integrodifferential equations for certain multivariate L 'evy processes to present alternative architectures of ReLU DNNs that provide varepsilon expression error in DNN size mathcal O ( log( varepsilon) a) with exponent a sim d , however, with constants implied in mathcal O ( cdot) growing exponentially with respect to d . Under stronger, dimension uniform non degeneracy conditions on the L 'evy symbol, we obtain algebraic expression rates of option prices in exponential L 'evy models which are free from the curse of dimensionality. In this case the ReLU DNN expression rates of prices depend on certain sparsity conditions on the characteristic L 'evy triplet. We indicate several consequences and possible extensions of the present results.


Transformer Based Deliberation for Two Pass Speech Recognition. Interactive speech recognition systems must generate words quickly while also producing accurate results. Two pass models excel at these requirements by employing a first pass decoder that quickly emits words, and a second pass decoder that requires more context but is more accurate. Previous work has established that a deliberation network can be an effective second pass model. The model attends to two kinds of inputs at once encoded audio frames and the hypothesis text from the first pass model. In this work, we explore using transformer layers instead of long short term memory (LSTM) layers for deliberation rescoring. In transformer layers, we generalize the "encoder decoder" attention to attend to both encoded audio and first pass text hypotheses. The output context vectors are then combined by a merger layer. Compared to LSTM based deliberation, our best transformer deliberation achieves 7 relative word error rate improvements along with a 38 reduction in computation. We also compare against non deliberation transformer rescoring, and find a 9 relative improvement.


The Generalized Persistence Diagram Encodes the Bigraded Betti Numbers. We show that the generalized persistence diagram (introduced by Kim and M 'emoli) encodes the bigraded Betti numbers of finite 2 parameter persistence modules. More interestingly, we show that the bigraded Betti numbers can be visually read off from the generalized persistence diagram in a manner parallel to how the bigraded Betti numbers are extracted from interval decomposable modules. Our results imply that all of the invariants of 2 parameter persistence modules that are computed by the software RIVET are encoded in the generalized persistence diagram. In addition, we verify that a certain recent invariant of finite 2 parameter persistence modules that was introduced by Asashiba et al. also encodes the bigraded Betti numbers.


Synerise at RecSys 2021 Twitter user engagement prediction with a fast neural model. In this paper we present our 2nd place solution to ACM RecSys 2021 Challenge organized by Twitter. The challenge aims to predict user engagement for a set of tweets, offering an exceptionally large data set of 1 billion data points sampled from over four weeks of real Twitter interactions. Each data point contains multiple sources of information, such as tweet text along with engagement features, user features, and tweet features. The challenge brings the problem close to a real production environment by introducing strict latency constraints in the model evaluation phase the average inference time for single tweet engagement prediction is limited to 6ms on a single CPU core with 64GB memory. Our proposed model relies on extensive feature engineering performed with methods such as the Efficient Manifold Density Estimator (EMDE) our previously introduced algorithm based on Locality Sensitive Hashing method, and novel Fourier Feature Encoding, among others. In total, we create numerous features describing a user's Twitter account status and the content of a tweet. In order to adhere to the strict latency constraints, the underlying model is a simple residual feed forward neural network. The system is a variation of our previous methods which proved successful in KDD Cup 2021, WSDM Challenge 2021, and SIGIR eCom Challenge 2020. We release the source code at https github.com Synerise recsys challenge 2021


Approximation properties of the double Fourier sphere method. We investigate analytic properties of the double Fourier sphere (DFS) method, which transforms a function defined on the two dimensional sphere to a function defined on the two dimensional torus. Then the resulting function can be written as a Fourier series yielding an approximation of the original function. We show that the DFS method preserves smoothness it continuously maps spherical H "older spaces into the respective spaces on the torus, but it does not preserve spherical Sobolev spaces in the same manner. Furthermore, we prove sufficient conditions for the absolute convergence of the resulting series expansion on the sphere as well as results on the speed of convergence.


Optimal Dividends under Model Uncertainty. We consider a diffusive model for optimally distributing dividends, while allowing for Knightian model ambiguity concerning the drift of the surplus process. We show that the value function is the unique solution of a non linear Hamilton Jacobi Bellman variational inequality. In addition, this value function embodies a unique optimal threshold strategy for the insurer's surplus, thereby making it the smooth pasting of a non linear and linear part at the location of the threshold. Furthermore, we obtain continuity and monotonicity of the value function and the threshold strategy with respect to the parameter that measures ambiguity of our model.


Effects of Dynamic Win Stay Lose Learn model with voluntary participation in social dilemma. In recent years, Win Stay Lose Learn rule has attracted wide attention as an effective strategy updating rule, and voluntary participation is proposed by introducing a third strategy in Prisoner's dilemma game. Some researches show that combining Win Stay Lose Learn rule with voluntary participation could promote cooperation more significantly under moderate temptation values, however, cooperators' survival under high aspiration levels and high temptation values is still a challenging problem. In this paper, inspired by Achievement Motivation Theory, a Dynamic Win Stay Lose Learn rule with voluntary participation is investigated, where a dynamic aspiration process is introduced to describe the co evolution of individuals' strategies and aspirations. It is found that cooperation is extremely promoted and defection is almost extinct in our model, even when the initial aspiration levels and temptation values are high. The combination of dynamic aspiration and voluntary participation plays an active role since loners could survive under high initial aspiration levels and they will expand stably because of their fixed payoffs. The robustness of our model is also discussed and some adverse structures are found which should be alerted in the evolutionary process. Our work provides a more realistic model and shows that cooperators may prevail defectors in an unfavorable initial environment.


A Generative Approach for User Centered, Collaborative, Domain Specific Modeling Environments. The use of low and no code modeling tools is today an established way in practice to give non programmers an opportunity to master their digital challenges independently, using the means of model driven software development. However, the existing tools are limited to a very small number of different domains such as mobile app development, which can be attributed to the enormous demands that a user has on such a tool today. These demands exceed the mere use of a modeling environment as such and require cross cutting concerns such as easy access, direct usability and simultaneous collaboration, which result in additional effort in the realization of such tools. Our solution is based on the idea to support and simplify the creation of new domain specific holistic tools by generating it entirely based on a declarative specification with a domain specific meta tool. The meta tool Pyro demonstrated and analyzed here focuses on graph based graphical languages to fully generate a complete, directly executable tool starting from a meta model in order to meet all cross cutting requirements.


Monte Carlo calculation of organ and effective dose rates from ground contaminated by Am 241 Results of an international intercomparison exercise. An intercomparison exercise is described that examines Monte Carlo modelling of anthropomorphic voxel phantoms in an idealized ground contamination photon exposure scenario. Thirteen participants calculated and submitted organ and effective dose rates for comparison against a set of verified reference solutions. The effective dose rates are shown to agree with the reference value to within reasonable statistical uncertainties in five of the cases, though in only one of those was similar agreement also demonstrated in the evaluation of all requested organ dose rates. Orders of magnitude differences in doses are seen for some of the other participants, both internally within their own dataset and also relative to the reference solutions. Following limited feedback and suggestions from the organizer, up to two sets of revised solutions were resubmitted by some of the participants these generally exhibited improved agreement, though not always. The overall observations and conclusions from this intercomparison exercise are summarized and discussed.


Types and Terms Translated Unrestricted Resources in Encoding Functions as Processes (Extended Version). Type preserving translations are effective rigorous tools in the study of core programming calculi. In this paper, we develop a new typed translation that connects sequential and concurrent calculi it is governed by expressive type systems that control resource consumption. Our main contribution is the source language, a new resource lambda calculus with non determinism and failures, dubbed ulamf. In ulamf, resources are sharply separated into linear and unrestricted failures are explicit and arise following this separation. We equip ulamf with a type system based on non idempotent intersection types, which controls resources and fail prone computation. The target language is an existing session typed pi calculus, s pi , which results from a Curry Howard correspondence between linear logic and session types for concurrency. Our typed translation of ulamf into s pi subsumes our prior work interestingly, it elegantly treats unrestricted resources in lamrfailunres as client server session behaviors in s pi .


Some inequalities on Riemannian manifolds linking Entropy,Fisher information, Stein discrepancy and Wasserstein distance. For a complete connected Riemannian manifold M let V in C 2(M) be such that mu(d x) rm e V(x) mbox vol (d x) is a probability measure on M . Taking mu as reference measure, we derive inequalities for probability measures on M linking relative entropy, Fisher information, Stein discrepancy and Wasserstein distance. These inequalities strengthen in particular the famous log Sobolev and transportation cost inequality and extend the so called Entropy Stein discrepancy Information (HSI) inequality established by Ledoux, Nourdin and Peccati (2015) for the standard Gaussian measure on Euclidean space to the setting of Riemannian manifolds.


A General Framework for Hypercomplex valued Extreme Learning Machines. This paper aims to establish a framework for extreme learning machines (ELMs) on general hypercomplex algebras. Hypercomplex neural networks are machine learning models that feature higher dimension numbers as parameters, inputs, and outputs. Firstly, we review broad hypercomplex algebras and show a framework to operate in these algebras through real valued linear algebra operations in a robust manner. We proceed to explore a handful of well known four dimensional examples. Then, we propose the hypercomplex valued ELMs and derive their learning using a hypercomplex valued least squares problem. Finally, we compare real and hypercomplex valued ELM models' performance in an experiment on time series prediction and another on color image auto encoding. The computational experiments highlight the excellent performance of hypercomplex valued ELMs to treat high dimensional data, including models based on unusual hypercomplex algebras.


Hate, Obscenity, and Insults Measuring the Exposure of Children to Inappropriate Comments in YouTube. Social media has become an essential part of the daily routines of children and adolescents. Moreover, enormous efforts have been made to ensure the psychological and emotional well being of young users as well as their safety when interacting with various social media platforms. In this paper, we investigate the exposure of those users to inappropriate comments posted on YouTube videos targeting this demographic. We collected a large scale dataset of approximately four million records and studied the presence of five age inappropriate categories and the amount of exposure to each category. Using natural language processing and machine learning techniques, we constructed ensemble classifiers that achieved high accuracy in detecting inappropriate comments. Our results show a large percentage of worrisome comments with inappropriate content we found 11 of the comments on children's videos to be toxic, highlighting the importance of monitoring comments, particularly on children's platforms.


The Golden Angle is not Constructible. We prove that the golden angle (an angle that divides the circle in the golden ratio) is not constructible using straightedge and compass.


Tighter Bounds for Reconstruction from epsilon samples. We show that reconstructing a curve in mathbb R d for d geq 2 from a 0.66 sample is always possible using an algorithm similar to the classical NN Crust algorithm. Previously, this was only known to be possible for 0.47 samples in mathbb R 2 and frac 1 3 samples in mathbb R d for d geq 3 . In addition, we show that there is not always a unique way to reconstruct a curve from a 0.72 sample this was previously only known for 1 samples. We also extend this non uniqueness result to hypersurfaces in all higher dimensions.


An Age of Information Characterization of Frameless ALOHA. We provide a characterization of the peak age of information (AoI) achievable in a random access system operating according to the frameless ALOHA protocol. Differently from previous studies, our analysis accounts for the fact that the number of terminals contending the channel may vary over time, as a function of the duration of the previous contention period. The exact characterization of the AoI provided in this paper, which is based on a Markovian analysis, reveals the impact of some key protocol parameters such as the maximum length of the contention period, on the average peak AoI. Specifically, we show that setting this parameter so as to maximize the throughput may result in an AoI degradation.


Google Landmark Retrieval 2021 Competition Third Place Solution. We present our solutions to the Google Landmark Challenges 2021, for both the retrieval and the recognition tracks. Both solutions are ensembles of transformers and ConvNet models based on Sub center ArcFace with dynamic margins. Since the two tracks share the same training data, we used the same pipeline and training approach, but with different model selections for the ensemble and different post processing. The key improvement over last year is newer state of the art vision architectures, especially transformers which significantly outperform ConvNets for the retrieval task. We finished third and fourth places for the retrieval and recognition tracks respectively.


Demonstration Guided Reinforcement Learning with Learned Skills. Demonstration guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration guided RL treat every new task as an independent learning problem and attempt to follow the provided demonstrations step by step, akin to a human trying to imitate a completely unseen behavior by following the demonstrator's exact muscle movements. Naturally, such learning will be slow, but often new behaviors are not completely unseen they share subtasks with behaviors we have previously learned. In this work, we aim to exploit this shared subtask structure to increase the efficiency of demonstration guided RL. We first learn a set of reusable skills from large offline datasets of prior experience collected across many tasks. We then propose Skill based Learning with Demonstrations (SkiLD), an algorithm for demonstration guided RL that efficiently leverages the provided demonstrations by following the demonstrated skills instead of the primitive actions, resulting in substantial performance improvements over prior demonstration guided RL approaches. We validate the effectiveness of our approach on long horizon maze navigation and complex robot manipulation tasks.


Revisiting Li Yau type inequalities on Riemannian manifolds. Inspired Yau's work (Comm. Anal. Geom., 1994), in this short note we provide a new version of Li Yau gradient estimate for the linear heat equation, which generalizes some known results and gives new gradient estimates. Also we explain the different known results as different cases here.


Leveraging Public Private Blockchain Interoperability for Closed Consortium Interfacing. With the increasing adoption of private blockchain platforms, consortia operating in various sectors such as trade, finance, logistics, etc., are becoming common. Despite having the benefits of a completely decentralized architecture which supports transparency and distributed control, existing private blockchains limit the data, assets, and processes within its closed boundary, which restricts secure and verifiable service provisioning to the end consumers. Thus, platforms such as e commerce with multiple sellers or cloud federation with a collection of cloud service providers cannot be decentralized with the existing blockchain platforms. This paper proposes a decentralized gateway architecture interfacing private blockchain with end users by leveraging the unique combination of public and private blockchain platforms through interoperation. Through the use case of decentralized cloud federations, we have demonstrated the viability of the solution. Our testbed implementation with Ethereum and Hyperledger Fabric, with three service providers, shows that such consortium can operate within an acceptable response latency while scaling up to 64 parallel requests per second for cloud infrastructure provisioning. Further analysis over the Mininet emulation platform indicates that the platform can scale well with minimal impact over the latency as the number of participating service providers increases.


LFPT5 A Unified Framework for Lifelong Few shot Language Learning Based on Prompt Tuning of T5. Existing approaches to lifelong language learning rely on plenty of labeled data for learning a new task, which is hard to obtain in most real scenarios. Considering that humans can continually learn new tasks from a handful of examples, we expect the models also to be able to generalize well on new few shot tasks without forgetting the previous ones. In this work, we define this more challenging yet practical problem as Lifelong Few shot Language Learning (LFLL) and propose a unified framework for it based on prompt tuning of T5. Our framework called LFPT5 takes full advantage of PT's strong few shot learning ability, and simultaneously trains the model as a task solver and a data generator. Before learning a new domain of the same task type, LFPT5 generates pseudo (labeled) samples of previously learned domains, and later gets trained on those samples to alleviate forgetting of previous knowledge as it learns the new domain. In addition, a KL divergence loss is minimized to achieve label consistency between the previous and the current model. While adapting to a new task type, LFPT5 includes and tunes additional prompt embeddings for the new task. With extensive experiments, we demonstrate that LFPT5 can be applied to various different types of tasks and significantly outperform previous methods in different LFLL settings.


Multi View Fusion for Multi Level Robotic Scene Understanding. We present a system for multi level scene awareness for robotic manipulation. Given a sequence of camera in hand RGB images, the system calculates three types of information 1) a point cloud representation of all the surfaces in the scene, for the purpose of obstacle avoidance 2) the rough pose of unknown objects from categories corresponding to primitive shapes (e.g., cuboids and cylinders) and 3) full 6 DoF pose of known objects. By developing and fusing recent techniques in these domains, we provide a rich scene representation for robot awareness. We demonstrate the importance of each of these modules, their complementary nature, and the potential benefits of the system in the context of robotic manipulation.


Nonlinear compact localized modes in flux dressed octagonal diamond photonic lattice. Tuning the values of artificial flux in the two dimensional octagonal diamond lattice drives topological phase transitions, including between singular and non singular flatbands. We study the dynamical properties of nonlinear compact localized modes that can be continued from linear flatband modes. We show how the stability of the compact localized modes can be tuned by the nonlinearity strength or the applied artificial flux. Our model can be realized using ring resonator lattices or nonlinear waveguide arrays.


Towards Fully Declarative Program Analysis via Source Code Transformation. Advances in logic programming and increasing industrial uptake of Datalog inspired approaches demonstrate the emerging need to express powerful code analyses more easily. Declarative program analysis frameworks (e.g., using logic programming like Datalog) significantly ease defining analyses compared to imperative implementations. However, the declarative benefits of these frameworks only materialize after parsing and translating source code to generate facts. Fact generation remains a non declarative precursor to analysis where imperative implementations first parse and interpret program structures (e.g., abstract syntax trees and control flow graphs). The procedure of fact generation thus remains opaque and difficult for non experts to understand or modify. We present a new perspective on this analysis workflow by proposing declarative fact generation to ease specification and exploration of lightweight declarative analyses. Our approach demonstrates the first venture towards fully declarative analysis specification across multiple languages. The key idea is to translate source code directly to Datalog facts in the analysis domain using declarative syntax transformation. We then reuse existing Datalog analyses over generated facts, yielding an end to end declarative pipeline. As a first approximation we pursue a syntax driven approach and demonstrate the feasibility of generating and using lightweight versions of liveness and call graph reachability properties. We then discuss the workability of extending declarative fact generation to also incorporate semantic information.


Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try On Systems. In this paper, we develop a robust 3D garment digitization solution that can generalize well on real world fashion catalog images with cloth texture occlusions and large body pose variations. We assumed fixed topology parametric template mesh models for known types of garments (e.g., T shirts, Trousers) and perform mapping of high quality texture from an input catalog image to UV map panels corresponding to the parametric mesh model of the garment. We achieve this by first predicting a sparse set of 2D landmarks on the boundary of the garments. Subsequently, we use these landmarks to perform Thin Plate Spline based texture transfer on UV map panels. Subsequently, we employ a deep texture inpainting network to fill the large holes (due to view variations self occlusions) in TPS output to generate consistent UV maps. Furthermore, to train the supervised deep networks for landmark prediction texture inpainting tasks, we generated a large set of synthetic data with varying texture and lighting imaged from various views with the human present in a wide variety of poses. Additionally, we manually annotated a small set of fashion catalog images crawled from online fashion e commerce platforms to finetune. We conduct thorough empirical evaluations and show impressive qualitative results of our proposed 3D garment texture solution on fashion catalog images. Such 3D garment digitization helps us solve the challenging task of enabling 3D Virtual Try on.


Pruning vs XNOR Net A Comprehensive Study of Deep Learning for Audio Classification on Edge devices. Deep learning has celebrated resounding successes in many application areas of relevance to the Internet of Things (IoT), such as computer vision and machine listening. These technologies must ultimately be brought directly to the edge to fully harness the power of deep learning for the IoT. The obvious challenge is that deep learning techniques can only be implemented on strictly resource constrained edge devices if the models are radically downsized. This task relies on different model compression techniques, such as network pruning, quantization, and the recent advancement of XNOR Net. This study examines the suitability of these techniques for audio classification on microcontrollers. We present an application of XNOR Net for end to end raw audio classification and a comprehensive empirical study comparing this approach with pruning and quantization methods. We show that raw audio classification with XNOR yields comparable performance to regular full precision networks for small numbers of classes while reducing memory requirements 32 fold and computation requirements 58 fold. However, as the number of classes increases significantly, performance degrades, and pruning and quantization based compression techniques take over as the preferred technique being able to satisfy the same space constraints but requiring approximately 8x more computation. We show that these insights are consistent between raw audio classification and image classification using standard benchmark sets. To the best of our knowledge, this is the first study to apply XNOR to end to end audio classification and evaluate it in the context of alternative techniques. All codes are publicly available on GitHub.


Pattern avoidance of 4,k pairs in circular permutations. The study of pattern avoidance in linear permutations has been an active area of research for almost half a century now, starting with the work of Knuth in 1973. More recently, the question of pattern avoidance in circular permutations has gained significant attention. In 2002 03, Callan and Vella independently characterized circular permutations avoiding a single permutation of size 4 . Building on their results, Domagalski et al. studied circular pattern avoidance for multiple patterns of size 4 . In this article, our main aim is to study circular pattern avoidance of 4,k pairs, i.e., circular permutations avoiding one pattern of size 4 and another of size k . We do this by using well studied combinatorial objects to represent circular permutations avoiding a single pattern of size 4 . In particular, we obtain upper bounds for the number of Wilf equivalence classes of 4,k pairs. Moreover, we prove that the obtained bound is tight when the pattern of size 4 in consideration is 1342 . Using ideas from our general results, we also obtain a complete characterization of the avoidance classes for 4,5 pairs.


On WL rank and WL dimension of some Deza dihedrants. The WL rank of a graph Gamma is defined to be the rank of the coherent configuration of Gamma . The WL dimension of Gamma is defined to be the smallest positive integer m for which Gamma is identified by the m dimensional Weisfeiler Leman algorithm. We establish that some families of strictly Deza dihedrants have WL rank 4 or 5 and WL dimension 2 . Computer calculations imply that every strictly Deza dihedrant with at most 59 vertices is circulant or belongs to one of the above families. We also construct a new infinite family of strictly Deza dihedrants whose WL rank is a linear function of the number of vertices.


Hollow core fibers with ultralow loss in the ultraviolet range and sub thermodynamic equilibrium surface roughness. We report on hollow core fibers displaying rms core roughness under the surface capillary waves thermodynamic limit and record loss in the short wavelength range (50.0 dB km at 290 nm, 9.7 dB km at 369 nm, 5.0 dB km at 480 nm, 0.9 dB km at 558 nm, 1.8 dB km at 719 nm).


On assuring the accurate alignment of laser sheets for planar and stereoscopic PIV. Several calibration techniques have been proposed in the literature for the calibration of two component two dimensional (2C 2D) particle image velocimetry (PIV) and three component two dimensional (3C 2D) stereoscopic PIV (SPIV) systems. These techniques generally involve the use of a calibration target that is assumed to be at the exact centre of the laser sheet within the field of view (FOV), which in practice is very difficult to achieve. In 3C 2D SPIV, several methods offer different correction schemes based on the computation of a disparity map, which are aimed at correcting errors produced due to this misalignment. These techniques adjust the calibration of individual cameras to reduce the disparity error, but in doing so can create unintended errors in the measurement position and or the velocity measurements, such as introducing a bias in the measured three component (3 C) displacements. This paper introduces a novel method to ensure accurate alignment of the laser sheet with the calibration target so that the uncertainty in displacement measurements is less than or equal to the uncertainty inherent to the PIV and hence, no correction scheme is required. The proposed method has been validated with a simple experiment in which true displacements are given to a particle container (illuminated by an aligned laser sheet) and the measured 3C displacements are compared with the given true displacements. An uncertainty of less than 7.6 micrometres (equivalent to 0.114 pixels) in the measured 3C displacements demonstrates the effectiveness of the new alignment method and eliminates the need for any ad hoc post correction scheme.